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OPINION 


FOCUSED  GRADUATE  EDUCATION: 

AN  IHVISIBLE  BUT  REAL 
COMPETITIVE  EDGE 

Dr,  Roland  D,  Kankey,  Dr,  Jan  P,  IRuciyk,  and  Col  Neal  M,  Ely,  USAF 


The  future  mission  of  the  Air  Force  wili  be  diverse  and  complex.  Advanced 
technology  will  play  an  increasingly  prominent  role;  a  smaller  force  must 
accomplish  more.  To  support  this  mission,  our  acquisition  corps  must  be 
intellectually  capable,  well  educated  and  trained.  Focused  graduate  education 
will  be  essential  to  sustain  this  effort. 


The  Air  Force  has  long  recognized 
the  value  of  quality  education,  as 
is  evident  from  the  following 
axiom:  “Success  in  war  depends  at  least 
as  much  on  intellectual  superiority  as  it 
does  on  numerical  and  technological  su¬ 
periority”  (Department  of  the  Air  Force, 
1992).  In  this  era  of  right-sizing  and  try¬ 
ing  to  do  more  with  less,  the  oft-uttered 
phrase  “work  smarter,  not  harder”  seems 
to  underscore  the  importance  of  education. 
In  other  words,  the  Air  Force’s  competi¬ 
tive  edge  in  the  future,  both  on  the  battle¬ 
field  and  in  system  acquisition,  will  de¬ 
pend  in  a  large  measure  on  that  part  of  the 
human  anatomy  that  rests  on  the  shoul¬ 
ders. 

For  those  of  us  in  the  field  of  acquisi¬ 
tion,  this  would  appear  to  be  particularly 
applicable  given  the  direction  in  which  the 
Air  Force  (and  for  that  matter  every  ser¬ 


vice)  is  headed.  In  the  words  of  the  former 
Secretary  of  the  Air  Force,  the  Honorable 
Sheila  E.  Windall,  and  the  previous  Chief 
of  Staff,  General  Ronald  R.  Fogleman,  the 
Air  Force  faces  a  period  of  profound 
change.'  Although  it  is  easier  to  explain 
the  past  than  to  predict  the  future,  there 
are  some  assumptions  that  can  reasonably 
be  made  about  certain  aspects  of  this 
change. 

In  the  future,  the  activities  involved  in 
executing  the  Air  Force’s  mission  (which 
includes  equipping  and  training)  will  be¬ 
come  more  diverse  and  complex,  and  may 
involve  operations  and  acquisitions  that 
are  novel  and  nontraditional.  While  the  Air 
Force  (and  the  Department  of  Defense 
[DoD])  of  the  future  will  most  likely  be 
smaller,  based  on  the  experience  of  the 
past  few  years  the  tempo  of  operation  will 
likely  be  faster  paced  and  less  predictable 
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than  in  the  old  Cold  War  environment. 
Forces  may  be  deployed  more  frequently, 
and  under  the  new  Air  Expeditionary 
Force  concept,  they  will  probably  be  de¬ 
ployed  in  smaller,  nonstandard,  unit- 
equipped  deployment  packages 
(Fogleman,  1996).  Advanced  technology, 
in  the  form  of  weapon  systems,  informa¬ 
tion  management,  etc.,  will  play  ever  more 
prominent  roles,  and  in  all  cases,  we  in 
acquisition  will  have  to  provide  reliable, 
affordable,  and  state-of-the-art  equipment 
and  information  systems  to  support  the 
warfighter.  All  these  elements  are  consis¬ 
tent  with  the  Air  Force’s  new  strategic  vi¬ 
sion  of  “global  engagement”  (Secretary  of 
the  Air  Force,  1996). 

As  the  operational  tempo  increases, 
enormous  pressures  exist  to  reduce  de¬ 
fense  spending  in  concert  with  deficit  re¬ 
duction  and  budget  balancing.  Yet  as  a 
result  of  a  decade  of  steady  decline  in  the 
defense  budget,  much  of  the  activity  sur¬ 


rounding  what  budget  authority  is  avail¬ 
able  will  involve  how  to  ramp  up  and 
maintain  adequate  spending  for  force 
modernization  (to  provide  systems  needed 
for  potential  future  conflicts)  while  main¬ 
taining  acceptable  present  and  future  force 
structure  (White,  1996).  Acquisition  re¬ 
form  and  technology  will  play  a  signifi¬ 
cant  role  in  how  we  acquire  new  weapon 
systems  for  this  modernization,  and  ini¬ 
tiatives  such  as  clear  identification  of  DoD 
core  capabilities  and  the  transfer  of  spe¬ 
cialized  military  technology  to  the  civil¬ 
ian  sector  will  enhance  the  efficiency  and 
effectiveness  in  both  the  military  and  com¬ 
mercial  industrial  bases. 

Most  recently,  the  Chairman  of  the  Joint 
Chiefs  of  Staff  published  Joint  Vision  201 0 
(1996),  his  template  for  the  operational 
evolution  of  the  Armed  Forces,  which  ac¬ 
knowledges  that  technologically  superior 
equipment  has  been  critical  to  the  success 
of  our  forces  in  combat.  We  will  need  a 


Roland  D.  Kankey  (Ph.D.,  Ohio  State  University)  is  head  of  the  Department  of  Graduate  Acqui¬ 
sition  Management  within  the  Graduate  School  of  Logistics  and  Acquisition  Management.  Dr. 
Kankey  came  to  AFIT  in  1 977  following  service  as  a  management  analyst  at  Rome  Air  Develop¬ 
ment  Center,  Chief  of  Management  Analysis  at  Osan  Air  Base  (Korea),  and  a  management 
analyst  and  cost  analyst  at  HO  USAF.  An  expert  in  cost  analysis,  Kankey  served  on  the  faculty 
for  13  years  prior  to  assuming  his  responsibilities  as  department  head.  He  is  also  a  colonel  in 
the  Air  Force  Reserve,  assigned  to  the  Aeronautical  Systems  Center. 

Jan  P.  Muczyk  (D.B.A.,  University  of  Maryland)  is  the  dean  of  the  Graduate  School  of  Logistics 
and  Acquisition  Management  at  the  Air  Force  Institute  of  Technology.  Before  coming  to  AFIT  in 
1995,  Professor  Muczyk  spent  22  years  at  Cleveland  State  University.  He  served  in  a  number 
of  significant  assignments  there  including  Interim  Dean  of  the  College  of  Business  Administra¬ 
tion,  Senior  Vice  President  for  Resource  Planning  and  Campus  Cperations,  and  Executive 
Assistant  to  the  President  and  Associate  Provost. 

Col.  Neal  M.  Ely  (Ph.D.,  Texas  A&M  University)  is  the  dean  of  the  School  of  Systems  and 
Logistics  at  the  Air  Force  Institute  of  Technology.  Previously  he  was  associate  dean  of  the 
Graduate  School  of  Logistics  and  Acquisition  Management.  He  has  served  in  a  variety  of  logis¬ 
tics  and  acquisition  jobs  prior  to  his  arrival  at  AFIT  in  1995.  These  include  assignments  as 
Deputy  Director  for  the  National  Missile  Defense  Readiness  Program  at  the  Ballistic  Missile 
Defense  Crganization;  Deputy  Director  for  Strategic  Defense  Initiative  Logistics  at  Space  Sys¬ 
tems  Division;  and  Program  Manager  for  the  Ground  Launched  Cruise  Missile’s  depot,  the 
European  Repair  Facility. 
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responsive  research,  development,  and 
acquisition  process  to  properly  incorpo¬ 
rate  these  new  technologies.  The  need  to 
overcome  bureaucratic  inertia,  to  change 
the  way  we  do  business,  is  cited  as  a  re¬ 
quirement  for  future  military  success 
(LaBerge,  1996).  It  is  well  understood  that 
education  is  one  of  the  few  acceptable 
methods  to  overcome  inertia  and  change 
people’s  behavior.  Our  acquisition  corps 
must  be  intellectually  capable,  well  edu¬ 
cated  and  trained,  and  be  able  to  create  an 
acquisition  process  to  match  the  rapidly 
developing  acquisition  reform  initiatives 
and  legislation,  as  well  as  the  emerging 
industrial  base  and  system  requirements 
of  the  future.  In  this  future,  dramatic 
changes  will  be  wrought  by  technology: 
changes  in  our  weapons  systems,  changes 
in  our  acquisition  processes,  changes  in 
our  information  systems  and  information 
management,  and  changes  in  our  logistics. 
As  indicated  in  Global  Engagement,  our 
core  competencies  are  the  combination  of 
professional  knowledge,  airpower  exper¬ 
tise,  and  technological  know-how  that  pro¬ 
duces  superior  military  capabilities  (Sec¬ 
retary  of  the  Air  Force,  1996).  Weapons 
system  acquisition  specialists  will  be  key 
to  incorporation  of  modem  and  develop¬ 
ing  technologies  into  operational  weapon 
systems  and  the  acquisition  of  these  sys¬ 
tems  at  affordable  prices. 

Acquisition  functions  will  not  be  ex¬ 
empt  from  increased  “right-sizing”  and 
budgetary  pressures  as  we  attempt  to  bal¬ 
ance  support  for  the  current  and  future 
warfighter  with  achievement  of  a  leaner 
infrastructure.  In  addition,  activities  that 
occur  away  from  the  flightline  will  be 
closely  scrutinized  for  civilianization, 
privatization,  and  outsourcing.  The  impact 
of  all  this  will  create  changes  in  the  size 


and  composition  of  the  force,  as  well  as 
in  certain  activities  performed  by  remain¬ 
ing  personnel.  The  mission  of  the  Air 
Force,  although 

it  may  appear  to  need  f  o  ever- 

look  different,  come  bureaucratic 
will  endure  or  Inertia,  to  change 
perhaps  even  the  way  we  do 
grow.  There-  business^  is  cited  as 
fore,  a  smaller  «  requirement  for 
number  of  indi-  ^******'®  miiitary 
viduals  will  be  *”***f*"  (l-aBerge,  ; 
expected  to  per-  '* 

form  a  larger 

number  and  greater  variety  of  tasks  and 
duties,  and  they  will  have  less  time  to  pre¬ 
pare  for  them. 

A  pressing  need  will  exist  for  a  force 
multiplier  to  help  ensure  our  future  success, 
both  on  and  off  the  bat-tlefield.  This  will 
be  especially  true  for  the  rapidly  evolving 
acquisition  career  field  to  help  those  in  it 
become  “the  world’s  smartest  buyers.” 
Those  responsible  for  acquiring  and  sus¬ 
taining  next-generation  systems  will  need 
the  intellectual  acumen  to  “name  that 
tune”  after  hearing  just  two  or  three  notes. 
This  article  will  discuss  graduate  educa¬ 
tion  as  a  component  of  the  force  multi¬ 
plier,  and  the  need  for  appropriate  focus 
in  graduate  education. 


Education  and  Technology  Are 
Force  Multipliers 


The  most  effective  force  multiplier  is 
really  a  multivariate  equation  consisting 
of  an  able,  motivated,  and  well-led 
workforce  with  appropriate  training  and 
education,  and  supported  by  state-of-the- 
art  technology  (Muczyk  &  Hastings, 
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1985).  A  small  force  leveraged  by  the 
above-mentioned  enabling  factors  can 
defeat  a  much  larger  force  that  lacks  one 
or  more  of  the  aforementioned  elements. 
The  Israeli  experience  since  1947  and  the 
U.S. -Coalition  defeat  of  a  larger  Iraqi 
force  in  the  Persian  Gulf  War  constitute 
two  excellent  examples  of  the  power  of 
the  force  multiplier  equation. 

The  concept  of  education  as  a  “force 
multiplier”  has  broad  general  applicabil¬ 
ity  and  is  not 

"...ilbih.  rapid 

transformation  of  operational 

innovation  into  military.  For  in- 

products  and  stance,  an  anal- 

services  through  ogy  can  be 

'management'  drawn  between 

technology  that  the  future  need 

provides  the  com-  for  this  force 

petitive  edge  in  the  multiplier  by 

marklplace." 

(including  its 
acquisition  function),  and  the  need  for  a 
similar  force  multiplier  in  the  private  sec¬ 
tor,  if  it  is  to  remain  healthy  and  competi¬ 
tive  in  the  future.  Simply  put,  success  for 
both  will  depend  on  a  qualitative  rather 
than  a  quantitative  edge.  The  Air  Force  is 
moving  to  a  smaller,  higher  technology 
force,  where  success  will  be  a  result  of 
qualitative  rather  than  quantitative  factors. 

On  the  economic  front,  the  United 
States  cannot  compete  with  China,  India, 
Indonesia,  Mexico,  and  other  developing 
nations  as  far  as  labor-intensive  industries 
are  concerned  (Higgins,  1991).  If  the 
United  States  is  to  enjoy  a  promising  eco¬ 
nomic  future,  it  must  concentrate  on  high- 
technology,  communications-oriented, 
knowledge-intensive  industries.  These 
industries  require  a  well-educated,  tech¬ 
nical  workforce  (i.e.,  the  force  multiplier). 


Without  this,  the  nation  will  lack  a  com¬ 
petitive  edge,  and  will  wind  up  exporting 
its  wealth  to  more  productive  nations 
(Dunham  &  Pierce,  1989).  This  is  why  so 
many  successful  companies  emphasize 
quality  education  through  reimbursement 
programs.  This  creates  a  powerful  win- 
win  situation  for  the  company,  its  employ¬ 
ees,  and  its  stockholders.  This  relationship 
is  recognized  and  understood  within  the 
private  sector,  and  that  is  why  individuals 
who  have  a  quality  technical  education  are 
doing  better  than  ever  before,  while  those 
who  do  not  are  losing  ground  (Howard, 
1995). 


The  Saliency  or 
Management  Technology 


Typically,  the  term  technology  conjures 
up  the  realm  of  Thomas  Edison  and  his 
lab — that  is  to  say,  “physical”  technology. 
Yet  there  is  another  technology  that  is  be¬ 
coming  even  more  important,  and  that  is 
“management”  technology.  By  this  we 
mean  the  organizational  patterns  and  man¬ 
agement  systems  that  society  develops  to 
administer  key  institutions.  In  light  of  the 
difficulty  of  protecting  physical  technol¬ 
ogy,  international  patent  agreements  not¬ 
withstanding,  it  is  the  rapid  transforma¬ 
tion  of  innovation  into  products  and  ser¬ 
vices  through  “management”  technology 
that  provides  the  competitive  edge  in  the 
marketplace.  Japan’s  economic  miracle 
can  be  largely  attributed  to  its  superior 
management  technology,  which  creates 
the  illusion  that  the  Japanese  are  more  in¬ 
novative  on  the  physical  technology  fron¬ 
tier  than  they  actually  are  (Muczyk  & 
Hastings,  1985).  In  other  words,  leading- 
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edge  management  technology  makes  it 
possible  to  exploit  physical  technology 
and  provide  the  necessary  cycle  time  ad¬ 
vantage  (Muczyk,  1990;  LaBerge,  1996; 
Clubb,  1996). 

On  the  military  front,  we  simply  must 
come  to  terms  with  the  reality  that  multi¬ 
national  and  transnational  corporations 
produce  most  of  the  technology,  and  prac¬ 
tically  anyone  can  obtain  it  either  directly 
or  through  third  parties.  Once  the  techno¬ 
logical  genie  is  released,  no  amount  of 
secrecy  and  effort  can  put  it  back  in  the 
bottle.  Therefore,  quickly  transforming 
available  technology  through  the  most  ef¬ 
ficient  management  systems  and  organi¬ 
zational  patterns  into  superior  weapon 
systems  is  paramount.  The  importance  of 
management  technology  is  further  high¬ 
lighted  by  the  necessity  to  obtain  the  big¬ 
gest  “bang  for  the  buck”  in  the  systems 
we  are  acquiring. 

Generic  Versus  Focused  Education 

On  the  educational  front,  the  value  of 
focused  versus  generic  graduate  education 
is  being  hotly  debated  not  only  by  the  pri¬ 
vate  sector,  but  also  by  the  military  (Air 
Force  Institute  of  Technology  [AFIT], 
1996).^  To  be  certain,  the  value  added  of 
focused  education  is  quite  elusive  and  dif¬ 
ficult  to  quantify.  Some  examples  are  in 
order.  There  is  an  abundance  of  success¬ 
ful  flag  officers  who  are  products  of  un¬ 
dergraduate  and  graduate  civilian  pro¬ 
grams.  Does  that  imply  that  the  more  ex¬ 
pensive  military  academies  are  a  waste  of 
taxpayers’  funds?  Moreover,  most  corpo¬ 
rate  executives  receive  their  degrees  from 
public  universities,  and  not  all  of  the  de¬ 
grees  are  in  business  administration. 


Should  parents  stop  sending  their  off¬ 
spring  to  the  more  expensive  private  in¬ 
stitutions,  and  should  we  discourage  stu¬ 
dents  from  at¬ 
tending  busi¬ 
ness  schools?  In 
like  manner,  one 
could  point  to 
numerous  suc¬ 
cessful  military 
logisticians  who 
obtained  their 
graduate  educa¬ 
tion  in  civilian 
institutions. 

Thus,  the  cen¬ 
tral  question  be¬ 
comes:  Does 
the  promotion  rate  in  the  world  of  work 
constitute  the  only  or  the  best  criterion  for 
evaluating  education?  We  think  not,  and 
more  will  be  said  on  this  point  later.  Since 
it  is  in  vogue  to  look  to  the  private  sector 
for  “best  practices,”  we  shall  oblige. 

Focused  Graduate  Education 
AS  A  Best  Practice 

Historically,  U.S.  firms  relied  on  ge¬ 
neric  education.  The  industry-  and  com¬ 
pany-specific  knowledge  and  practices 
were  to  be  obtained  through  on-the-job 
experience  and  the  training  provided  by 
the  company  through  a  variety  of  continu¬ 
ing  education  instramentalities.  Even  busi¬ 
ness  schools  were  expected  to  provide 
only  the  knowledge  and  practices  that 
were  common  across  organizations;  while 
everything  else  was  the  responsibility  of 
the  employer.  The  “big  six”  accounting 
firms  provide  a  superb  example  of  that 
model  through  their  training  centers  that 
offer  a  comprehensive  catalog  of  courses 
that  prepare  young  people  who  already 


"On  the  military 
front,  we  simply 
must  come  to  terms 
with  the  reality  that 
multinational  and 
transnational  corpo¬ 
rations  produce 
most  of  the  technol¬ 
ogy,  and  practically 
anyone  can  ebtain  it 
eithei'  directly  or 
through  third  par¬ 
ties." 


371 


Acquisition  Review  Quarteriy — Fall  1997 


possess  generic  accounting  degrees  to  be¬ 
come  public  auditors,  tax  specialists,  or 
consultants.  Certainly,  there  have  been 
exceptions  all  along,  with  the  best  example 
being  the  General  Motors  Institute,  which 
provided  focused  degrees  for  General 
Motors  employees. 

More  recently,  though,  many  U.S.  cor¬ 
porations  have  concluded  that  focused 
education  is  the  best  business  practice, 
even  though  initially  it  is  more  expensive, 
and  are  resorting  to  teaming  arrangements 
with  civilian  graduate  schools  in  order  to 
tailor  management  programs  to  the  spe¬ 
cific  needs  of 
their  organiza¬ 
tion.  This  has 
compelled  a 
number  of  busi¬ 
ness  schools  to 
move  out  of  their 
ivory  towers  to 
forge  partner¬ 
ships  with  cor¬ 
porations,  result¬ 
ing  in  multifac¬ 
eted,  long-lasting,  and  strategic  alliances 
that  fuse  business  practice  and  business 
education.  A  recent  report  estimates  that 
companies  with  management  education 
and  training  divisions  called  colleges,  in¬ 
stitutes  or  universities  increased  from  400 
to  more  than  1,000  between  1988  and 
1995  (Hoffman,  1997;  “The  Corporate 
University  Boom,”  1996;  “Corporate  Uni¬ 
versities  Grow  in  Stature,”  1997).  Among 
the  best  known  are  Motorola  University 
and  the  MBA  program  offered  by  the 
Arthur  D.  Little  School  of  Management. 

The  aforementioned  trend  is  evident 
abroad  as  well,  since  international  execu¬ 
tives  also  believe  that  focused  education 


The  ability  to  tackle 
subjects  of  immedi* 
ate  relevance  in  a 
direct  manner  holds 
much  appeal  to  most 
managers,  regard¬ 
less  of  nationality  or 
geography 
(Bradshcnw,  1997; 
Griffith,  1997). 


makes  a  larger  and  more  immediate  im¬ 
pact  on  the  organization,  because  it  deals 
with  the  company’s  specific  problems, 
solutions,  opportunities,  and  threats.  The 
ability  to  tackle  subjects  of  immediate  rel¬ 
evance  in  a  direct  manner  holds  much  ap¬ 
peal  to  most  managers,  regardless  of  na¬ 
tionality  or  geography  (Bradshaw,  1997; 
Griffith,  1997).  Likewise,  teaming  ar¬ 
rangements  between  a  private  firm  and  an 
educational  institution  permit  responsive¬ 
ness  to  the  ever-changing  needs  of  the 
firm,  thereby  providing  a  competitive 
edge. 

A 1996  survey  of  organizations  partici¬ 
pating  in  focused  education  programs  re¬ 
vealed  that  the  impetus  provided  by  rapid 
change  is  largely  responsible  for  the 
customization  trend,  with  the  desire  to 
align  education  with  an  organization’s 
goals,  to  spread  organizational  culture,  and 
to  enhance  the  employability  of  organiza¬ 
tional  members  (“The  Corporate  Univer¬ 
sity  Boom,”  1996).  The  same  survey  ad¬ 
ministered  in  1997  produced  the  follow¬ 
ing  list  of  benefits  from  focused  educa¬ 
tion:  1)  enhanced  job  performance  (37 
percent);  2)  communication  of  mission/ 
vision  and  values  (31  percent);  3)  devel¬ 
opment  of  a  world-class  leadership  pro¬ 
gram  (24  percent);  4)  establishment  of  a 
systematized  education  process  (18  per¬ 
cent);  and  5)  the  educational  programs  as 
an  agent  of  change  for  the  organization 
(13  percent)  (“Corporate  Universities 
Grow,”  1997).  It  is  interesting  to  note  that 
in  the  latest  survey  a  bottom-line  impact 
was  cited  most  frequently  as  the  most 
valuable  contribution  of  focused  educa¬ 
tion. 
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Orgahizational  Culture  as  an  Important 
Performance  Variable 

An  increasing  number  of  executives  are 
recognizing  the  importance  of  organiza¬ 
tional  culture,  and  are  expending  signifi¬ 
cant  resources  to  create  and  maintain  a 
culture  that  reinforces  organizational  goals 
and  objectives.  Focused  education  is 
viewed  by  certain  executives  as  a  more 
effective  vehicle  for  propagating  a  desired 
culture  than  is  generic  education,  and  for 
good  reason.  Putting  a  significant  num¬ 
ber  of  members  of  the  same  organization 
through  the  same  intense,  extended  expe¬ 
rience  not  only  inculcates  shared  values, 
but  reinforces  them  as  well.  After  all, 
shared  values  are  the  stuff  of  which  cul¬ 
ture  is  made. 

The  Air  Force’s  recognition  of  the  im¬ 
portance  of  organizational  culture  played 
an  important  role  in  its  creation  of  the  new 
Air  and  Space  Basic  Course.  Additionally, 
now  that  the  Continental  United  States 
(CONUS)  C-130  community  and  opera¬ 
tional  support  airlift  have  been  reassigned 
to  the  Air  Mobility  Command  (AMC),  the 
need  for  the  development  and  growth  of 
an  AMC  culture  has  been  accentuated. 
One  of  the  vehicles  to  accomplish  this  goal 
is  through  the  AFIT  Master  of  Air  Mobil¬ 
ity  Degree  at  the  Air  Mobility  Warfare 
Center,  Fort  Dix,  NJ,  which  is  embedded 
in  the  Advanced  Study  of  Air  Mobility 
Program  (Larsen,  1997). 

The  Defense  Department  Analogy 

For  more  than  50  years,  the  U.S.  mili¬ 
tary  has  relied  on  both  above-mentioned 
models.  Some  officers  were  sent  to  civil¬ 
ian  universities  for  generic  degrees.  These 


officers  were  then  focused  through  pro¬ 
fessional  continuing  education  (PCE) 
courses  as  well  as  through  on-the-job  ex¬ 
perience.  Others  were  sent  to  organic 
graduate  schools — AFIT  and  the  Naval 
Post  Graduate  School  (NPS),  with  reduced 
subsequent  PCE  obligations.  The  Army 
did  not  operate  its  own  organic  graduate 
school  but  uti¬ 
lized  both  AFIT  "foeosed  education 
and  NPS,  and  jg  yievured  by  certain 
for  certain  pro-  executives  as  a  more 
grams,  such  as  effective  vehicle  for 
Financial  Man-  prepdgatihg  a 
agement,itpart-  desired  culture  than 
nered  with  a  ci-  is  generic  educa- 
vilian  university. 

One  could  even 

make  a  cogent  case  that  educational  di¬ 
versity  contributed  to  the  preeminence  of 
our  armed  forces.  The  rationale  for  this 
dichotomy  was  straightforward.  In  those 
areas  where  the  differences  between  ci¬ 
vilian  and  military  applications  were 
small,  a  generic  degree  was  acceptable. 
Otherwise,  an  organic  degree  was  pre¬ 
ferred. 

Military  establishments  of  other  nations 
also  rely  on  organic  education.  One  of  the 
better  known  is  the  United  Kingdom  Min¬ 
istry  of  Defense  Graduate  School  at  Ports¬ 
mouth.  Interestingly,  the  Graduate  School 
of  Logistics  and  Acquisition  Management 
at  AFIT  provides  not  only  a  model  for 
some  of  our  allies,  but  also  the  “seed 
com.”  That  is,  certain  countries  send  of¬ 
ficers  to  AFIT,  who,  after  graduation,  go 
back  as  instmctors  and  administrators  of 
their  own  organic  schools.  In  addition, 
they  use  many  of  the  course  materials  to 
which  they  have  been  exposed  at  AFIT. 
Brazil  serves  as  the  best  example. 
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The  New  Order 


Since  the  disintegration  of  the  Soviet 
Empire,  practically  everything  has  be¬ 
come  budget  driven  and  the  “80  percent 
solution”  is  acceptable  (i.e.,  since  the  last 
20  percent  of  performance  is  the  most  dif¬ 
ficult  and  expensive  to  obtain,  in  the  ab¬ 
sence  of  a  clear  and  present  danger,  80 
percent  of  performance  is  good  enough). 
Few  would  argue  that  an  organic  gradu¬ 
ate  school  adds  value.  The  crux  of  the  de¬ 
bate,  however,  revolves  around  the  ques¬ 
tion:  Does  the  value  added  justify  the 
greater  cost? 

We  need  to  be  quite  candid  for  the  mo¬ 
ment.  Using  promotion  rates  as  a  proxy 
measure  of  the  value  of  focused  organic 
versus  generic  civilian  education  is  haz¬ 
ardous  indeed,  because  the  nexus  between 

promotion  rates 
and  contribu¬ 
tion  of  organi¬ 
zational  mem¬ 
bers  is  based  on 
a  considerable 
leap  of  faith.  On 
the  other  hand, 
alternative  cri¬ 
teria  cannot  be 
defended  with  incontrovertible  evidence 
either.  Let  us  illustrate  with  examples  close 
to  home.  We  have  been  assured  that  the 
success  of  the  Air  Force  program  known 
as  “lean  logistics”  was  made  possible  by 
AFIT  graduates,  and  not  necessarily  by  the 
highest  ranking  ones.  Yet,  these  officers 
undoubtedly  had  the  same  promotion  rates 
as  their  counterparts  with  graduate  degrees 
from  civilian  institutions.  Time  and  time 
again,  we  are  assured  by  customers  that 
AFIT  graduates  do  not  require  a  learning 
curve  to  speak  of,  as  do  their  counterparts 


"Using  premetien 
rales  as  a  proxy 
measure  of  the  value 
of  focused  organic 
versus  generic  civil¬ 
ian  education  is 
hazardous  indeed..." 


from  civilian  institutions.  Also,  individu¬ 
als  proclaim  publicly  that  hiring  AFIT 
graduates  is  the  best  business  practice  they 
know  of.  Yet,  organic  graduate  education, 
for  better  or  for  worse,  stands  or  falls  on 
the  value  that  its  customers  and  corporate 
leadership  place  on  five  characteristics 
inherent  in  organic  graduate  education:  1) 
a  focused  curriculum,  2)  relevant  research, 
3)  responsiveness  to  customer  needs,  4) 
mission-ready  graduates,  and  5)  enhanced 
assimilation  of  organizational  culture. 

Should  focused  graduate  education  be 
the  best  business  practice  within  the  Air 
Force?  To  begin  to  answer  this  question, 
we  must  first  discuss  the  overall  require¬ 
ment  for  graduate  education  for  the  Air 
Force.  As  noted  previously,  the  Air  Force 
and  DoD  are  moving  into  a  future  defined 
not  only  by  evolutionary  forces  but  also 
by  a  revolution  in  military  affairs;  and 
acquisition  reform,  “right-sizing,”  fund¬ 
ing  availability,  privatization,  out-sourc¬ 
ing,  lease  versus  buy  decisions,  and  mis¬ 
sion  issues  will  all  play  roles  in  this  dy¬ 
namic  environment.  As  discussed  earlier, 
a  smaller  Air  Force  will  require  a  force 
multiplier  to  achieve  its  competitive  ad¬ 
vantage  in  much  the  same  way  as  the  pri¬ 
vate  sector,  and  largely  for  the  same  rea¬ 
sons — namely,  a  highly  educated  techni¬ 
cal  force  structure.  In  the  current 
downsizing  environment,  we  must  be  on 
guard  when  applying  the  concept  of  pro¬ 
portional  cuts  to  education.  Under  the  pro¬ 
portionality  argument,  since  the  Air  Force 
has  become  smaller,  the  number  of  ad¬ 
vanced  academic  degree  (AAD)  require¬ 
ments  should  shrink  proportionately.  This 
is  a  specious  argument  and,  in  fact,  quite 
the  opposite  is  the  case.  Just  as  a  higher 
proportion  of  the  civilian  workforce  in  a 
high-technology,  knowledge-based,  and 


374 


Focused  Graduate  Education:  An  Invisible  Bat  Real  Competitive  Edge 


communications-oriented  economy  needs 
focused  quality  graduate  degrees,  so  do 
the  men  and  women  of  tomorrow’s  Air 
Force. 

This  observation  applies  not  just  to  the 
select  few  deemed  to  be  the  future  leaders 
who  must  chart  our  course,  but  to  person¬ 
nel  at  all  levels  charged  with  the  day-to- 
day  operation  of  a  high-tech,  high  tempo 
Air  Force,  including  those  who  will  be 
acquiring  and  sustaining  its  systems.  The 
devil  is  typically  in  the  implementation, 
and  the  individuals  who  do  the  actual 
implementing  are  found  at  all  levels  of  the 
organization.  If  key  people  at  all  levels 
lack  the  appropriate  education,  poor 
implementation  will  frastrate  the  best  laid 
plans  (such  as  decreasing  cycle  time 
[Clubb,  1996],  or  elevating  the  importance 
of  a  bidder’s  past  performance  as  a  source 
selection  criterion)  every  time. 

In  today’s  (and  tomorrow’s)  fast-paced, 
fluid  environment,  the  Air  Force  and  DoD 
will  need  more  people  with  the  skills  and 
tools  they  accrue  from  a  focused  graduate 
education.  These  include  not  only  the  tech¬ 
nical  and  informational  skills  related  to 
one’s  major  course  of  study,  but  the  ana¬ 
lytical,  problem  solving,  and  rational 
thinking  abilities  one  develops  as  part  of 
a  graduate  education.  These  tools  are  es¬ 
pecially  important  because  they  can  be 
applied  throughout  a  career,  and  to  a  broad 
array  of  problems  and  situations.  Educa¬ 
tion,  after  all,  is  what  is  left  after  all  the 
job-specific  knowledge  and  skills  are  re¬ 
moved.  A  smaller  Air  Force  needs  more 
advanced,  quality  technical  degrees  be¬ 
cause  it  no  longer  has  large  numbers  of 
people,  inventory,  and  an  abundance  of 
funds  to  throw  at  problems.  The  remain¬ 
ing  folks  will  have  to  solve  unusual  and 
complex  problems  with  brain  power.  That 


is  why  the  Air  Force  Scientific  Advisory 
Board  (AFSAB),  in  New  World  Vistas, 
recognized  this  reality  and  specifically 
offered  AFIT  as  an  example  of  a  source 
of  Air  Force  relevant  quality  graduate 
technical  degrees  (AFSAB,  1995).  Given 
the  resource-constrained  environment, 
with  its  manpower  reductions  and  up¬ 
tempo  implications,  the  Air  Force  can  no 
longer  afford  a  square  checking  exercise 
in  graduate  education. 

All  of  us  know  there  are  quality  civil¬ 
ian  institutions,  and  where  “one  size  fits 
all,”  they  should  be  utilized — and  they 
are.^  '*  But  civil¬ 
ian  institutions  .  . 

are  not  inter- 

j  ^  .  tpitierrow'sj  fast- 

ested 

technologies 

because  they  force  anil  PoD  will 

lack  large-scale  need  more  people 
commercial  ap-  wilh  the  skills  and 
plications.  Fur-  fools  they  accrue 

thermore,  while  from  a  focused 
many  of  the  fl^adoale  educa- 

DoD  acquisition 
orders  deal  with 

primarily  commercial  goods  (commodi¬ 
ties,  office  supplies,  etc.)  to  be  sure,  other 
subsets  are  quite  different  (combat  aircraft, 
munitions,  missiles,  etc.).  Likewise,  some 
of  our  acquisition  goals  and  a  substantial 
amount  of  the  DoD  acquisition  environ¬ 
ment  (especially  the  legal  aspects)  are 
markedly  dissimilar  from  commercial 
practices,  which  are  the  only  ones  taught 
at  civilian  universities.  Finally,  the  “fog 
and  friction”  of  combat  necessitates  a  tai¬ 
lor-made  logistics  system  (Pagonis  & 
Cruikshank,  1992).  We  must  face  the  re¬ 
ality  that  many  pure  “just-in-time”  logis¬ 
tics  systems  are  severely  taxed  by  the 
Christmas  rush  and  incapacitated  by  a 
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United  Parcel  Service  labor  stoppage.  To 
quote  more  fully  from  Global  Engagement 
(1996): 

People  are  at  the  heart  of  the  Air 
Force’s  military  capability,  and 
people  will  continue  to  be  the 
most  important  element  of  the  Air 
Force’s  success  in  capitalizing  on 
change.  The  Air  Force  of  tomor¬ 
row  and  beyond  must  encourage 
individuals  to  be  comfortable 
with  uncertainty  and  willing  to 
make  decisions  with  less  than 
perfect  information.  Accordingly, 
our  people  must  understand  the 
doctrine,  culture,  and  competen¬ 
cies  of  the  Air  Force  as  a  whole — 
in  addition  to  mastering  their  own 
specialties.  Emphasis  on  creating 
an  Air  Force  environment  that 
fosters  responsiveness  and  inno¬ 
vation,  and  rewards  adaptability 
and  agility,  will  be  crucial  as  we 
move  into  the  early  part  of  the 
next  century. 

The  qualities  and  skills  cited  in  the 
aforementioned  quote  are  needed  to  cre¬ 
ate  suitable  DoD  acquisition  and  logistics 
systems,  processes,  and  procedures;  and 
they  are  exactly  the  attributes  provided  by 
the  kind  of  focused  graduate  degrees  of¬ 
fered  at  AFIT  and  NPS. 

On  a  broader  scale,  AFIT’s  two  gradu¬ 
ate  schools  undeniably  contribute  two  of 
the  enabling  elements  in  the  force  multi¬ 
plier  equation  discussed  earlier.  Certain 
technologies  are  of  interest  principally  to 
the  Air  Force  and  the  DoD,  such  as:  high- 
energy  lasers,  low  observable  technolo¬ 
gies,  target  recognition,  autonomous 
weapon  systems,  and  unmanned  aerial 


vehicles.  AFIT’s  School  of  Engineering 
offers  not  only  focused  curricula  in  these 
areas,  but  also  conducts  relevant,  cutting- 
edge  research  on  these  vital  issues.  Gradu¬ 
ates  of  these  programs  are  anxious  and 
able  to  explode  out  of  the  starting  gate 
when  they  arrive  at  their  next  assignment. 

In  the  areas  of  acquisition  and  logistics, 
AFIT  for  years  has  also  provided  educa¬ 
tion  and  research  focused  with  an  Air 
Force/DoD  lens,  thereby  creating  mission- 
ready  graduates.  The  contributions  to 
management  technology  include  develop¬ 
ing  improved  information  resource  con¬ 
cepts  and  systems,  and  improved  manage¬ 
ment  of  a  weapon  system’s  life  cycle,  from 
system  acquisition  (including  acquisition 
logistics)  to  operational  logistics  support. 

In  addition  to  the  faculty’s  research 
streams,  over  90  percent  of  AFIT’s  thesis 
research  is  sponsored  by  external  Air 
Force  and  DoD  organizations.  As  noted 
earlier,  this  research  helps  to  solve  some 
of  the  key  problems  faced  by  the  Air  Force 
as  it  moves  into  the  next  century  and  pro¬ 
duces  graduates  better  able  to  address  ad¬ 
ditional  problems  in  the  future.  AFIT’s 
research  sponsors  have  recently  estimated 
that  the  value  of  the  research  they  receive 
is  about  $30  million  per  annum.  And  fully 
80  percent  responded  that  they  would  have 
funded  this  research  from  other  sources 
had  it  not  been  supplied  by  the  AFIT 
graduate  schools. 

The  Air  Force  Logistics  Management 
Agency  (AFLMA)  is  the  most  concen¬ 
trated  locus  of  AFIT  graduates.  This  as¬ 
signment  permits  these  young  officers  to 
hone  analytical  skills  acquired  in  gradu¬ 
ate  school  by  applying  them  to  some  of 
the  most  vexing  logistics  problems  fac¬ 
ing  the  Air  Force  and  the  DoD.  By  the  time 
they  complete  their  AFLMA  assignment. 
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these  officers  are  among  the  most  valu¬ 
able  assets  that  the  Air  Force  possesses. 

It  is  becoming  evident  that  in  today’s 
resource-constrained  environment,  the 
number  one  enemy  of  any  military  sys¬ 
tem  is  cost.  Whereas  in  the  past  the  em¬ 
phasis  was  placed  on  effectiveness,  today 
efficiency  is  of  equal  importance.  This  is 
particularly  true  in  the  field  of  acquisition, 
where  measures  of  efficiency  such  as  unit 
cost  and  life-cycle  cost  are  key  in  program¬ 
matic  decisions.  Economy  of  force,  one 
of  the  basic  principles  of  warfare,  has  been 
cited  as  one  of  the  justifications  for  con¬ 
sidering  different,  more  efficient,  ap¬ 
proaches  toward  acquisition  and  logistics 
mission  accomplishment  (Ely,  1997).  The 
entire  concept  of  cost  as  an  independent 
variable  (CAIV)  promotes  a  push  for  cost 
efficiency.  But  it  is  management  technol¬ 
ogy  that  in  large  measure  determines  effi¬ 
ciency.  In  all  likelihood,  cost  pressures 
will  elevate  the  importance  of  efficiency 
as  serious  attempts  are  made  to  balance 
the  federal  budget.  It  will  be  management 
technology,  focused  on  the  unique  aspects 
and  requirements  of  the  Air  Force,  that 
determines  how  successfully  this  branch 
of  the  services  executes  new  initiatives 
such  as  acquisition  reform,  lean  logistics, 
and  quality  management. 

Responsiveness  To  Air  Force  Needs 

As  the  nature  of  how  the  Air  Force  ac¬ 
complishes  its  mission  changes,  require¬ 
ments  for  new  areas  and  subjects  for  Air 
Force-focused  graduate  education  will  ap¬ 
pear;  and  the  graduate  education  process 
for  the  Air  Force  must  respond  to  these 
new  requirements.  It  will  be  of  paramount 
importance  that  these  changes  be  made  in  a 


timely  and  responsive  manner.  As  organic 
schools,  AFIT  and  NFS  have  always  con¬ 
sidered  responsiveness  and  flexibility  to 
be  core  competencies. 

As  an  example,  the  Graduate  School  of 
Logistics  and  Acquisition  Management 
has  recently  demonstrated  responsiveness 
by  implementing  a  new  graduate  program 
that  serves  as  a 

prototype  for  «„  ,,  becoming 
how  the  Chang-  evident  fhnf  in 
ing  graduate  fodoy's  resource - 
education  needs  censlrained  environ 

of  the  Air  Force  •««"*»  number 
could  be  met.  •"«  enemy  of  uny 
This  new  pro-  n*il>tdnf  system  is 

gram,  the  Mas-  *•*'* 
ter  of  Air  Mo¬ 
bility,  was  developed  for  the  AMC  in  con¬ 
junction  with  the  Advanced  Studies  of  Air 
Mobility  program  at  Fort  Dix,  NJ.  The 
competing  requirements  for  focused 
graduate  education  in  air  mobility,  and  the 
need  to  keep  the  students  involved  with 
the  mobility  mission,  required  the  use  of 
mixed  instructional  delivery  modes.  Many 
of  AFIT’s  specialized  courses  are  offered 
on-site  at  Fort  Dix.  AFIT  instructors  fly 
to  Fort  Dix  to  teach  courses  there  on  an 
accelerated  basis,  while  some  courses  are 
taught  at  the  AFIT  campus  and  delivered 
to  the  Air  Mobility  Warfare  Center  through 
satellite  hookup.  The  AFIT  library  is  con¬ 
nected  with  the  Air  Mobility  Warfare  Cen¬ 
ter  as  well.  This  program  was  initially  re¬ 
quested  by  the  Commander  of  AMC  in 
September  1994,  and  implemented  in  full 
as  an  accredited  master’s  program  in 
March  1995.^*'' 

As  an  important  side  note,  every  stu¬ 
dent  nominated  for  the  first  class  by  AMC 
already  possessed  a  master’s  degree  in  a 
different  discipline.  In  the  future,  the  re- 
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duced  manning,  increased  operational 
tempo,  and  (for  those  of  us  in  acquisition) 
downsized  program  offices  will  require 
that  students  spend  less  time  in  a  tradi¬ 
tional  campus  environment  than  their  pre¬ 
decessors  did.  Educational  systems  must 

respond  to  these 
'^1  the  moment,  changing  needs 
looking  to  best  by  taking  edu- 

business  practices  to  cation  to  the 
achieve  significant  student.  Clearly, 
efficiencies  within  technology  will 
;  the  DoD  is  the  order  modify  the  de- 
;  of  the  day."  livery  mode  of 

education  and 
training  by  making  distance  learning  much 
more  practical  and  effective  than  it  is  to¬ 
day,  thereby  decreasing  the  time  students 
spend  away  from  their  primary  duty. 
Within  the  Air  Force,  AFIT  is  a  leader  in 
pioneering  distance  learning,  and  we  are 
actively  considering  ways  to  reduce  the 
length  of  the  in-residence  portion  of  our 
masters  degrees. 

In  The  Final  Analysis 


Perhaps  the  ultimate  tradeoff  to  be  con¬ 
sidered  is  strictly  cost  versus  value.  Any 
graduate  school  that  produces  mission- 
ready  graduates  by  focusing  its  curricula 
and  research  on  customers’  needs  and  by 
being  responsive  as  part  of  its  mission 
(consultancy  is  included  in  AFIT’s  mis¬ 
sion)  will  be  more  expensive.  Ipso  facto, 
any  organization  (including  the  Air  Force) 
would  have  to  pay  a  premium  (or  provide 
a  subsidy)  to  a  civilian  institution  in  re¬ 
turn  for  receiving  the  same  responsive¬ 
ness,  attention,  and  focused  education  that 
AFIT  currently  provides. 


AFIT’s  Board  of  Visitors  determined 
that  the  investment  the  Air  Force  makes 
in  graduate  education  at  AFIT  ($13.4  mil¬ 
lion  per  year)  provides  an  impressive  re¬ 
turn  in  terms  of  mission-ready  graduates, 
as  well  as  focused  and  responsive  research 
and  consultancy.  The  Board  of  Visitors 
report  goes  on  to  say:  “AFIT  provides  an 
array  of  values  that  benefit  its  students, 
the  Air  Force  and,  ultimately,  the  entire 
nation.”  The  report  concludes  with  the 
following  remarks:  “While  there  is  a  pre¬ 
mium  to  be  paid  to  maintain  AFIT,  the 
Board  of  Visitors  is  unanimous  in  its  be¬ 
lief  that  there  is  a  richness  to  the  return  on 
investment  that  cannot  be  achieved  at 
more  traditional  civilian  educational  in¬ 
stitutions”  (“Report  of  the  AFIT  Board  of 
Visitors,”  1996).^ 

At  the  moment,  looking  to  best  busi¬ 
ness  practices  to  achieve  significant  effi¬ 
ciencies  within  the  DoD  is  the  order  of 
the  day.  It  would  be  ironic  indeed  to  aban¬ 
don  focused  graduate  education  at  a  time 
when  it  appears  that  it  is  being  recognized 
around  the  globe  by  the  private  sector  as 
the  best  business  practice. 

Summary 


The  acquisition  reform  initiatives  and 
the  Air  Force  Lightning  Bolts  are  only  the 
beginning — the  first  chapter  in  a  long 
saga.  To  successfully  change  our  acquisi¬ 
tion  processes  to  meet  our  future  needs, 
DoD  and  the  Air  Force  must  produce  not 
only  the  strategic  thinkers  in  this  critical 
arena  who  continuously  improve  existing 
management  technology  as  well  as  add  to 
the  extant  storehouse,  but  those  who  are 
able  to  implement  these  “best  laid  plans.” 
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In  an  era  of  ever-shrinking  budget  author¬ 
ity,  the  success  of  force  modernization  and 
acquisition  reforms  will  depend  on  those 
who  can  master  the  complexity  and  dy¬ 
namics  of  the  rapidly  changing  and  unique 
military  technological  and  acquisition  en¬ 
vironment.  Given  the  differences  between 
civilian  and  military  logistics  and  acqui¬ 
sition,  and  the  emphasis  on  efficiency  as 
well  as  effectiveness,  a  focused,  respon¬ 
sive,  and  quality  graduate  education  guar¬ 
antees  that  the  Air  Force  and  the  DoD  will 
receive  a  constant  stream  of  officers  and 
government  civilians  armed  with  the  stra¬ 
tegic  mental  acuity  to  solve  some  of  the 
most  vexing  problems  in  the  future. 

With  the  disintegration  of  the  Soviet 
Union,  no  nation  can  compete  with  the 
United  States  across  the  board  as  far  as 
physical  technology  is  concerned.  It  is 


imperative  that  such  is  also  the  case  vis- 
a-vis  management  technology,  for  with¬ 
out  it,  it  is  not  possible  to  exploit  the  full 
range  of  physical  technologies  that  a  na¬ 
tion  possesses.  Most  would  agree  that  in¬ 
stitutions  and  organizations  vested  with 
public  interest  should  be  directed  by  doc¬ 
trine  rather  than  personality  or  financial 
expediency.  The  evolution  of  mankind  has 
taken  such  a  path  that  it  is  now  the  size  of 
the  brain  that  constitutes  the  competitive 
edge  and  not  the  size  of  the  club.  But  this 
brain  must  be  honed  through  appropriate 
education  and  training.  Now,  more  than 
ever,  the  vital  education  element  of  the 
force  multiplier  equation  must  continue  to 
be  incorporated  as  a  fundamental  tenet  of 
Air  Force  and  DoD  doctrine.  The  conse¬ 
quences  of  not  doing  it  may  very  well  be 
unacceptable. 
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ENDNOTES 


1 .  Culled  from  numerous  speeches  given 
by  the  Secretary  and  Chief  of  Staff  of 
the  Air  Force  during  the  first  half  of 
1996. 

2.  Unlike  the  Air  Force,  which  is  debat¬ 
ing  the  future  of  the  graduate  educa¬ 
tion  at  AFIT,  the  U.S.  Navy  considers 
the  Naval  Postgraduate  School  a  “flag¬ 
ship”  educational  institution,  along  side 
the  Naval  Academy  and  the  Naval  War 
College,  to  be  preserved  as  a  valuable 
asset. 


3.  Given  the  fixed  costs  associated  with 
launching  a  new  program,  before  a  ci¬ 
vilian  university  would  consider  such 
a  decision,  it  would  require  a  guaran¬ 
tee  of  a  sizable  number  of  students  for 
an  extended  period  of  time. 

4.  Typically,  it  takes  two  years  or  more 
for  a  new  program  to  be  debated  and 
approved  by  all  the  curriculum  com¬ 
mittees,  the  faculty  senate,  and  for  pub¬ 
lic  universities,  the  Board  of  Regents 
or  the  Department  of  Education. 
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OPINION 


OUTUND:  THE  VOGUE  OF  DOD 
OUTSOURCING  AND  PRIVATIZATION 

i.  Miihael  Brower 


The  twin  silver  bullets  of  outsourcing  and  privatization  are  purported  to  be  the 
saviors  of  future  defense  budgets,  as  private  contractors  tout  their  ability  to 
produce  goods  that  retain  quality  while  cutting  costs.  But  this  ammunition 
should  be  examined  carefully  before  use,  for  its  effects  are  likely  to  be 
devastating  to  the  defense  industry’s  labor  force,  and  estimated  savings  may 
evaporate  once  large  segments  of  the  industry  are  turned  over  to  the  private 
sector. 


...Pharaoh  commanded  the  same  day  the  taskmas¬ 
ters  of  the  people,  and  their  officers,  saying.  Ye  shall 
no  more  give  the  people  straw  to  make  brick...Go  ye, 
get  you  straw  where  you  can  find  it:  yet  not  ought  of 
your  work  shall  be  diminished. 


The  Quadrennial  Defense  Review 
( QDR)  is  history — and  so  too  are 
the  hopes  of  many  defense  work¬ 
ers  for  relief  from  the  strains  of  post-Cold 
War  downsizing.  For  many,  the  time  of 
troubles  is  just  beginning.  The  QDR’s  re¬ 
port,  issued  May  19,  1997,  called  for  re¬ 
ductions  in  infrastructure,  support  func¬ 
tions,  and  personnel  to  fund  weapons  mod¬ 
ernization.  But  while  the  study  wisely  at¬ 
tempts  to  build  more  muscle  out  of  the 
defense  budget,  in  the  process  it  makes 
some  recommendations  that  have  poten¬ 


Exodus  5:6-7, 11 


tially  bone-breaking  consequences — 
while  leaving  some  fatty  deposits  of  pork 
quite  untouched.  In  a  well-meaning  at¬ 
tempt  to  put  mission  first,  the  QDR  for¬ 
gets  that  a  healthy  national  defense  puts 
people  first  always.  The  QDR’s  call  for 
unbridled  outsourcing  and  privatization  to 
supplant  modernization  accounts  intro¬ 
duces  a  sinister  game  of  musical  chairs 
that  will  put  many  defense  workers  off, 
behind,  down,  and  out. 

It  will  soon  be  argued  that  programs 
receiving  the  planned  financial  infusion 
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will  be  in  a  position  to  employ  the  tens  of 
thousands  of  workers  to  be  turned  out  into 
the  streets  under  the  QDR  and  con¬ 
comitant  Congressional  legislation.  But 
the  civilian  defense  industries  are  them¬ 
selves  largely  saturated  and  have  a  gen¬ 
eral  interest  only  in  those  with  advanced 
technical  skills.  Nevertheless,  there  will 
be  cheap,  unionless,  competent  workers 
coming  soon  to  an  unemployment  line 
near  you.  The  defense  workers  that  re¬ 
main —  uniformed  and  civil  service — will 
be  required  to  make  bricks  without  straw, 
to  do  even  more  with  noticeably  less,  and 
they  will  receive  a  firsthand  education  in 
two  rapidly  maturing  concepts,  known  as 
outsourcing  and  its  handmaiden  priva¬ 
tization. 

Hidden  Economic  Backhand 


Outsourcing  is  the  movement  of  work 
to  an  outside  provider  that  has  been  or 
might  be  performed  in-house.  Privati¬ 
zation  is  outsourcing  writ  large — the  gov¬ 
ernment  farms  out  the  function  and  often 
the  wherewithal  to  do  it,  getting  out  of  a 
business  more  logically  performed  by  the 
private  sector.  Privatization,  in  its  essen¬ 
tials,  is  a  reaction  to  the  nationalization 


and  government  regulation  of  the  late 
1960s  and  1970s  and  finds  inspiration  in 
the  post- 1979  conservative  policies  of 
British  Prime  Minister  Margaret 
Thatcher’s  government,  where  the  mod¬ 
em  privatization  mold  was  cast  (Vickers 
&  Yarrow,  1988).  But  the  concept  of 
privatization  is  not  new,  and  can  be  traced 
back  to  some  of  Adam  Smith’s  writings 
in  1762  (Kemp,  1991).  To  meet  the  ambi¬ 
tious  goals  of  the  QDR,  outsourcing  and 
privatization  must  be  relied  upon  as  never 
before  to  generate  cost  savings  and  cost 
avoidance  to  accommodate  the  proposed 
modernization  schedule  (Donnelly,  1996). 

With  a  sort  of  weary,  dull  surprise, 
many  who  have  overseen  some  outsour¬ 
cing  and  to  a  lesser  degree,  privatization 
projects,  are  discovering  that  these  “new 
ways  of  doing  business”  amount  only  to 
old  wine  in  new  bottles.  Contractors  bid 
for  outsourced  work  claiming  substantial 
savings,  government  employees  are 
surplused  or  RIFed,  then  (once  the  indig¬ 
enous  labor  source  is  shuffled  off  or  ab¬ 
sorbed)  the  contractors  run  up  the  bill. 
Uncle  Sam  then  has  nowhere  else  to  go, 
since  the  in-housers  have  been  benched 
in  the  name  of  savings  and  efficiencies.  It 
is  the  charge  and  duty  of  the  government 
employee  to  ensure  that  taxpayers  don’t 
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zine,  and  many  other  journals.  He  is  now  a  program  specialist  focusing  on  contracting, 
outsourcing,  and  privatization  issues  with  the  Department  of  Justice  in  South  Burlington,  VT. 
The  opinioris  expressed  in  this  article  are  those  of  the  author  and  not  necessarily  those  of  DoD 
or  the  Justice  Department.  He  can  be  e-mailed  at  john.m.brower@justice.usdoj.gov  or  con- 
2985?  homepage  located  on  the  Web  at:  www.geocities.com/capitolhill/lobby/ 
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get  fleeced — ^but  the  contractor’s  first  duty 
is  just  to  charge.  For  the  latter,  it  is  the 
stockholder,  not  the  taxpayer,  that  ulti¬ 
mately  controls  the  purse  strings.  And 
while  many  taxpayers  are  stockholders,  as 
professional  Wall  Street  watchers  will  tell 
you,  some  stockholders  are  more  equal 
than  others. 

Privatization  and  outsourcing  are  man¬ 
agement  paradigms  that  exist  because 
even  during  downsizing,  to  paraphrase 
Calvin  Coolidge,  the  business  of  America 
remains  business.  What  Eisenhower  called 
the  “military-industrial  complex”  is  an 
integral  part  of  the  U.S.  economy  and  the 
government.  After  the  Great  Depression, 
World  War  II,  and  curative  doses  of 
Keynesianism,  the  government  became 
industry’s  biggest  customer  and  the  two 
have  remained  joined  at  the  hip  ever  since. 
The  Cold  War  continued  and  deepened  the 
relationship.  Consequently,  in  the  QDR, 
and  in  the  laws  that  are  passed  in  legisla¬ 
tive  reaction,  tens  of  thousands  of  work¬ 
ers  for  America’s  largest  employer,  the 
Department  of  Defense  (DoD),  will  find 
their  fates  have  been  sealed  first  in  Ameri¬ 
can  and  foreign  boardrooms,  and  only  as 
an  afterthought  in  the  halls  of  Congress 
and  the  Pentagon. 

Indeed,  the  reason  that  the  QDR  can 
afford  to  be  so  modest  in  its  cuts  is  more  a 
reflection  of  a  healthy  corporate  economy 
that  can  afford  to  underwrite  $250  billion 
Defense  budgets  for  the  “foreseeable  fu¬ 
ture”  than  outright  threats  to  national  se¬ 
curity.  This  is  why  the  phrase  “security” 
doesn’t  receive  the  emphasis  that  the 
phrase  “national  interests”  enjoys  in  the 
Pentagon’s  QDR  study — and  “national 
interests,”  as  was  the  case  during  the  Gulf 
War,  are  generally  pecuniary  in  nature. 
The  determination,  then,  is  that  the  dam¬ 


age  done  to  the  economy  with  the  reduced 
spending  power  of  displaced  defense 
workers  and  those  in  their  train  is  more 
than  offset  by  positive  economic  effects 


of  industries 
sanctioned  ipso 
facto  by  the 
QDR.  Cuts  in 
infrastructure 
(i.e.,  military  in¬ 
stallations),  per¬ 
sonnel,  and  sup¬ 
port  functions 
will  be  required 
to  ensure  the 
health  of  large 
and  small  corporations  alike.  Privatization 
and  outsourcing  will  be  the  purest  expres¬ 
sion  of  the  sentiment  to  support  those  in¬ 
dustries  by  slashing,  among  other  stake¬ 
holders,  DoD’s  indigenous  workforce. 


"Privatization  and 
outsourcing  are 
mandgemont  para* 
digms  that  exist 
because  even  dur¬ 
ing  downsizing,  to 
paraphrase  Caivin 
Ceeiidge,  the  busi¬ 
ness  of  America 
remains  business/' 


McEmployee 


According  to  the  National  Association 
of  Temporary  and  Staffing  Services 
(NATSS)  in  Alexandria,  VA,  outsourcing 
trends  have  helped  explain  increases  in  the 
ranks  of  the  nation’s  temporary  employ¬ 
ees.  Temporary  work  of  all  descriptions 
has  doubled  in  the  last  five  years  and  in 
1995,  there  were  2.7  million  temporary 
workers  in  that  category. 

Additionally,  about  40  percent  of  the 
biggest  companies  in  the  United  States 
have  outsourced  at  least  one  major  piece 
of  their  operations,  according  to  Computer 
World  (Hoffman,  1997a).  DoD  is  emulat¬ 
ing  industry  and  will  be  outsourcing  and 
privatizing  more  than  ever. 

The  Navy,  for  example,  is  attempting 
to  save  more  than  $3  billion  over  the  next 
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six  years  by  designating  50,000  civilian 
and  30,000  military  positions  as 
outsourcing  candidates.  Fiscal  year  (FY) 
1997  will  see  the  final  preparations  for 
outsourcing  competitions  with  the  intent 
of  applying  the  savings  toward  procure¬ 
ment  accounts.  In  a  January  8, 1997,  mes¬ 
sage  from  Chief 

"The  principal  prob¬ 
lem  with  the  zealevs 
privalizer  and 
outsourcer  (a.k.a. 

"government  re¬ 
former")  is  that 
they  are  notoriously 
short-term  think¬ 
ers." 


of  Naval  Opera¬ 
tions  Adm.  Jay 
Johnson,  we  un¬ 
derstand  that 
the  “Navy’s 
program  objec¬ 
tives  memoran¬ 
dum  for  fiscal 
year  1998  in¬ 


cluded. ..3  bil¬ 
lion  in  savings  from  outsourcing,”  which 
Johnson  terms  an  “ambitious,  but  achiev¬ 
able  goal”  (Inside  the  Navy,  1997).  The 
Navy  is  continuing  to  study  outsourcing 
and  is  countenancing  Office  of  Manage¬ 


ment  and  Budget  (0MB)  Circular  76 
(“Performance  of  Commercial  Activi¬ 
ties”),  which  contains  competition  guide¬ 
lines  updated  in  early  1996,  in  anticipa¬ 
tion  of  contracting  out  more  than  10,000 
jobs  (about  8,400  civilian  and  2,300  mili¬ 
tary)  during  FY97.  The  Navy,  as  of  April 
1997,  had  about  408,000  military  and 
218,000  civilians  on  its  payroll.  As  the 
Navy  outsources  more  work  it  expects  to 
take  its  $3  billion  in  savings  and  plow  it 
back  into  modernization  programs  (Com¬ 
puter  World,  1997).  The  problem,  of 
course,  is  the  time  delay  between  bank¬ 
ing  those  savings,  and  meeting  program 
and  operations  and  maintenance  bills. 

The  principal  problem  with  the  zealous 
privatizer  and  outsourcer  (a.k.a.  “govern¬ 
ment  reformer”)  is  that  they  are  notori¬ 
ously  short-term  thinkers.  They  forget  or 


never  bother  to  calculate  the  stimulation 
that  government  paychecks  have  in  the 
economy.  In  the  private  sector,  a  firm  can 
hire  more  workers  when  demand  is  high, 
lay  them  off  during  a  lull  in  demand — but 
this  is  not  so  in  government.  The  axiom 
that  layoffs  boost  profits  in  the  short  term 
is  verifiable  (and  is  in  part  accountable  for 
the  historic  rise  of  the  U.S.  stock  market), 
but  long-term  effects  may  be  less  desir¬ 
able 

A  related  development,  which  is  gain¬ 
ing  momentum  and  adherents,  is  the  “fran¬ 
chising”  or  hiring  of  temporary  govern¬ 
ment  workers,  who  are  then  terminated  at 
project  completion.  Headlines  in  recent 
months  about  “payoffs  for  layoffs,”  an  is¬ 
sue  championed  by  independent  Vermont 
Rep.  Bemie  Sanders,  and  the  introduction 
of  legislation  such  as  the  “freedom  from 
government  competition”  bill,  all  center 
on  the  continuing  destmction  of  good,  tax- 
base  creating  jobs  in  the  public  and  pri¬ 
vate  sector.  Today’s  “government  re¬ 
former”  is  in  many  cases  using  priva¬ 
tization  and  outsourcing  as  cudgels  to  beat 
down  concepts  that  working  Americans 
did  not  always  associate  with  sloth:  steady 
employment,  good  fringe  benefits,  secu¬ 
rity,  decent  working  hours  and  conditions, 
paid  vacation  and  sick  time,  health  care,  a 
well-funded  retirement.  But  to  be  progres¬ 
sive  today,  one  cannot  support  these  no¬ 
tions.  The  popular  belief  in  this  country 
(unlike  in  Japan  and  Germany)  seems  to 
be  that  those  working  in  government  to¬ 
day  must  by  definition  be  deficient — they 
obviously  couldn’t  make  it  in  private  in¬ 
dustry.  Ridiculous  as  the  prejudice  is,  these 
concepts  are  spreading  according  to  criti¬ 
cally  acclaimed  books  such  as  Jeremy 
Rifkin’s  The  End  of  Work  (1995)  and  Wil¬ 
liam  Greider’s  One  World  Ready  or  Not: 
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The  Manic  Logic  of  Global  Capitalism 
(1997).  Both  authors  assert  that  privati¬ 
zation  and  outsourcing  will  continue 
apace,  no  matter  the  economic  or  social 
cost. 


Hew  Strains  of  Outsourcing 


A  review  of  outsourcing  and  priva¬ 
tization  literature  reveals  fewer  references 
to  fixed  costs,  rates  of  rent  or  taxes,  or  the 
price  of  capital  and  materials  than  to  the 
cost  of  labor.  In  the  main,  the  cost  cuts 
that  outsourcing  achieves  are  accom¬ 
plished  by  reducing  the  price  of  the  em¬ 
ployee.  By  capitalizing  on  the  specializa¬ 
tion  of  techniques,  specific  functions  done 
at  low  cost  can  trim  a  company’s  on-site 
workforce.  Two  new  genres  of  outsourc¬ 
ing  highlight  this  interest  in  reducing 
people-generated  expenses. 

Pure  Outsourcing 

Here  we  find  a  new  social  contract  at 
work — but  Locke  didn’t  have  this  one  in 
mind.  Private  industry  is  permitted  to  pur¬ 
chase,  at  a  discount,  publicly  underwrit¬ 
ten  facilities  and  acquire  trained  employ¬ 
ees  with  the  understanding  the  taxpayer 
will  end  up  with  a  better  deal.  This  is  the 
same  pretext  rationalizing  the  privatization 
of  the  U.S.  uranium  enrichment  business 
(Moses,  1997).  In  an  ode  to  outsourcing. 
National  Defense's  December  1996  issue 
states  the  case  plainly  enough.  Sandra  I. 
Meadows  introduces  “pure  outsourcing” 
(and  it  does  have  a  pleasant,  almost  reli¬ 
gious  ring  to  it).  The  new  addition  to  the 
lexicon  of  privatizers  and  outsourcers  is  a 
scheme  to  transfer  all  government  work¬ 
ers  and  all  government  assets  in  a  given 
field  into  the  waiting  hands  of  a  company. 


Addressing  the  popular  inclination  to 
outsource  information  systems,  “a  govern¬ 
ment  data  center  would  transfer  its  assets 
and  employees  to  a  private  firm,  which 
would  be  run¬ 
ning  the  opera- 


''Wifh  "pure 
outsourcing"  the 
public  underwritos 
the  priyalo  focfor 
by  yirtually  or 
litorOily  giving 
away  taxpayer- 
purcbasod  facilities 
and  assets,  cuts 
government's 
Ompleyee  costs  by 
transferring  work¬ 
ers  to  industiq^dnd 
saturates  the  labor 
peel." 


tion — becom 
ing  an  agency 
partner  rather  i 
than  just  a  sup¬ 
plier.”  Later  she 
writes,  “there  is 
mounting  pres¬ 
sure  on  corpora- 
tions,  both  in 
the  public  and 
private  sector, 
to  be  more  effi¬ 
cient,  to  per¬ 
form  new  func¬ 
tions  with  fewer  employees”  (Meadows, 
1996). 


With  “pure  outsourcing”  the  public  un¬ 
derwrites  the  private  sector  by  virtually 
or  literally  giving  away  taxpayer-pur¬ 
chased  facilities  and  assets,  cuts  govern¬ 
ment’s  employee  costs  by  transferring 
workers  to  industry,  and  saturates  the  la¬ 
bor  pool.  As  wages  fall,  the  regular  pay- 
checks  on  which  workers  depend  to  un¬ 
derwrite  their  bills  become  more  excep¬ 
tion  than  rule. 


Double  Outsourcing 

Also  known  as  “mad  cow  contracting- 
out,”  double  outsourcing  is  one  of  the  most 
hazardous  breeds  of  the  outsourcing  ani¬ 
mal.  Simply  put,  it  means  subcontracting 
to  the  nth  power — triple  or  even  quadruple 
outsourcing — and  it  is  daily  becoming 
more  the  rule  than  the  exception.  For  in¬ 
stance,  the  EDS  Company  supplied  infor¬ 
mation  technology  requirements  for  Gen- 
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eral  Motors  Corporation  for  more  than  12 
years.  Then  GM  negotiated  a  $3.6  billion 
deal  to  co-negotiate  with  EDS  (“double 
outsource”)  with  EDS’s  subcontractors 
{Information  Week,  1997).  Economies  of 
scale  are  realized  by  pooling  resources  and 
labor  costs  are  driven  to  lower  levels.  For 
example,  Microsoft  has  a  rather  modest 
employee  base  compared  to  its  revenue, 
due  in  part  to  an  aggressive  outsourcing 
strategy,  which  can  involve  double¬ 
outsourcing,  particularly  in  the  code  writ¬ 
ing  arena.  But  outsourcing  can  lead  to  se¬ 
vere  labor  problems:  the  machinist  strike 
at  McDonnell  Douglas,  which  started  in 
June  1996,  was  largely  fought  over  the 
question  of  outsourcing  to  nonunion  sub¬ 
contracts. 


Other  forms  of  outsourcing  run  the 
gamut  between  the  straight  GOGO  (gov¬ 
ernment-owned,  government-operated) 
model  and  the  COCO  (contractor-owned, 
contractor-operated)  model.  These  forms 


include  co-sourcing  (partnering  equip¬ 
ment  and  expertise  with  an  outsider),  and 
outsourcing  partnerships  (generally,  only 
the  technical  staff  is  outsourced). 

Outsourcing  also  finds  many  labor  cost 
savings  in  the  area  of  information  tech¬ 
nology,  and 
QDR’s  sugges¬ 
tion  that  DoD 
largely  remove 
itself  from  that 
line  of  work  has 
many  prece¬ 
dents  in  private 
industry  and  in 
other  parts  of 
government. 
The  Internal  Revenue  Service  is 
outsourcing  returns  processing,  while  the 
Academy  of  Motion  Picture  Arts  and  Sci¬ 


'nVpically,  the 
outsourcer  bids  low, 
gets  exclusive  rights 
to  control  an  entire 
information  technol* 
ogy  department, 
then  reams  the 
outseurcee  with  cost 
overruns." 


ences  is  relying  on  outsourcing  services 
rather  than  “overburden  [ing]  its  small 
Management  Information  Systems  (MIS) 
department.”  Brian  Riggs  reports  in  his 
piece  “Web  Outsourcing  Hits  Big  Time,” 
that  installing  and  operating  a  Web  server 
can  cost  above  $60,000  a  year — and  two 
full-time  computer  jockeys  added  on  boost 
the  price  to  $221,000  (Riggs,  1997).  But 
outsourcing  such  a  project  lowers  costs  to 
about  $40,000.  But  according  to  Computer 
World,  the  outsourcing  Siren  song  has  run 
many  companies  into  the  ground 
(Melymuka,  1997).  Typically,  the  out¬ 
sourcer  bids  low,  gets  exclusive  rights  to 
control  an  entire  information  technology 
department,  then  reams  the  outsourcee 
with  cost  overruns. 


Who  Really  Wants  Outsourcing 
AND  Privatization? 


At  the  Pentagon,  one  notices  that  those 
above  the  rank  of  colonel  and  GS-14  and 
political  appointees  are  almost  wholly  in 
favor  of  outsourcing  and  privatization.  For 
the  political  appointee  with  a  limited  fu¬ 
ture  in  government,  job  security  is  job 
none  anyway,  so  why  worry  about  the  fate 
of  middle  and  lower  income  taxpayers 
working  for  DoD?  For  the  high  grades, 
there  is  no  danger  of  them  becoming  vic¬ 
tims  of  privatization,  outsourcing  or  “re- 
invention”  in  general — quite  the  reverse! 
Mike  Causey’s  popular  federal  column  in 
the  Washington  Post  (1997)  featured  a 
Dickensian  commentary  on  the  haves  hav¬ 
ing  and  the  have-nots  having  nothing. 
Causey  estimates  that  between  1989  and 
March  1995,  the  number  of  GS-14s  and 
-15s  soared  during  downsizing  (14s  went 
from  69,000  to  83,000;  more  than  7,000 
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new  15s  were  created).  In  the  same  mo¬ 
ment,  those  in  grades  below  GS-7  have 
found  themselves  in  a  free-you’re-fired 
zone.  Since  “government  reinvention,” 
began,  GS-ls  have  been  virtually  elimi¬ 
nated,  GS-2s  lost  nearly  6,000  positions, 
GS-4s  were  cut  in  half,  and  GS-7s  were 
reduced  by  30,000  positions. 

On  both  the  military  and  civilian  side 
of  DoD,  we  see  a  pattern  common  with 
most  downsizing,  the  Personnel  Centrip¬ 
etal  Effect;  headquarter  staffs  swell  while 
the  field  shrivels.  To  preserve  the  upper 
grades,  work  done  by  the  lower  tier  is  con¬ 
tracted  out  (hence  the  worship  of  out¬ 
sourcing,  economical  or  not)  and  numbers 
of  employees  are  shown  to  decline.  The 
problem  is  that  those  who  can  least  afford 
to  go — the  young,  the  low  grades,  the 
“temps” — are  forced  out,  while  those  who 
can  easily  afford  departure  remain.  Vol¬ 
untary  retirements  and  incentives  have 
helped,  but  the  QDR  demands  more  cuts 
and  Congress  is  asking  for  still  deeper 
position  reductions. 

The  military  remains  hopelessly  top 
heavy.  A  few  years  ago,  the  Air  Force  ac¬ 
tually  had  to  eliminate  the  basic  rank  of 
“sergeant”  and  RIF  many  junior  officers, 
mainly  to  preserve  positions  in  the 
service’s  stratosphere.  In  the  QDR,  forces 
were  cut,  but  force  structure  was  pre¬ 
served.  Truly,  as  the  African  proverb  has 
it,  when  elephants  fight,  the  grass  suffers. 

In  a  sinister  twist,  there  is  now  a  big 
push  to  get  people  “off  welfare”  by  put¬ 
ting  many  of  them  into  the  government  in 
the  same  low-grade  categories  that  were 
sacrificed  on  the  alter  of  reinvention.  Pri¬ 
vate  industry  only  employs  up  to  the  point 
of  diminishing  returns:  when  employees 
cost  more  than  they  return  to  the  company 
in  profits,  they  become  economic  liabili¬ 


ties;  their  utility  is  at  an  end.  The  unthink¬ 
able  but  perfectly  practical  solution  would 
have  been  to  simply  lower  the  grades  of 
the  upper-level  military  and  civil  servants 
to  better  reflect  a  post-Cold  War  world, 
and  use  the  savings  to  avoid  cutting  jobs. 
Yet  no  economic  analysis  of  this  possibil¬ 
ity  was  con¬ 
ducted,  because 
of  the  antici¬ 
pated  conduct 
of  the  fox  when 
stationed  at  the 
hen  house.  In 
this  ironic  form 
of  social  level¬ 
ing,  many  of 
those  RIFed 
might  now  be 
reemployed  by 
the  government 
that  released  them  from  service  (and  don’t 
forget  about  veteran’s  preference  and  re¬ 
instatement  rules). 

Take  another  example  of  who  gets  what 
from  the  outsourcing  phenomenon.  The 
Defense  Science  Board’s  (DSB’s)  esti¬ 
mates  of  outsourcing  and  privatization 
savings  to  DoD  of  $30  billion  per  year  by 
2002  were  disputed  by  officials  in  the  Of¬ 
fice  of  the  Secretary  of  Defense’s  (OSD) 
program  analysis  and  evaluation  (PA&E) 
shop.  In  early  April,  PA&E’s  examination 
of  the  much-heralded  DSB  summer  study, 
“Achieving  an  Innovative  Support  Stmc- 
ture  for  21st  Century  Military  Superior¬ 
ity,”  indicated  that  even  after  aggressive 
contracting  out,  there  could  be  less  than 
$14.8  billion  in  savings  opportunities. 
Even  that  figure  would  depend  on  repeal 
of  restrictive  legislation,  higher  than  an¬ 
ticipated  personnel  cuts,  and  more  base 
realignment  and  closure  (BRAC)  proceed- 


"Privafe  industry 
only  employs  up  to 
the  point  of  dimin¬ 
ishing  returns: 
when  employee 
costs  more  them 
they  return  to  the 
company  in  profits, 
they  become  eco¬ 
nomic  liabilities; 
their  utility  is  at 
an  end/^ 


389 


Acquisifion  Review  Quarterly — Fall  1997 


ings.  Why  are  the  estimates  so  different 
by  so  many  billions? 

There  are  (at  least)  two  possible  expla¬ 
nations  for  the  discrepancies.  The  OSD 
PA&E  may  estimate  conservatively  be¬ 
cause  it  has  vested  interests  in  doing  so — 
just  as  the  members  of  the  DSB  have 

vested  interests 
in  liberal  esti¬ 
mates  in  the 
amount  to  be 
saved  through 
outsourcing  and 
privatization. 
OSD  PA&E 
would  see  more 
substantial  sav¬ 
ings  estimates  gobbled  up  to  fund  other 
programs  (the  higher  the  estimate  of  sav¬ 
ings,  the  greater  the  cuts  somewhere  else). 
Another  reason  for  the  disparity  could  be 
that  the  DSB  generally  consists  of  a  mem¬ 
bership  that  can  be  less  than  objective.  In 
the  course  of  examining  the  PA&E  analy¬ 
sis,  “most  reviews  are  performed  by 
people  who  have  a  stake  in  the  process” 
{Inside  the  Air  Force,  1997). 


"In  the  Iasi  analysis, 
the  relative  and 
socially  necessary 
labor  price  makes 
or  breaks  most 
privatization  and 
outsourcing  initia¬ 
tives." 


Paying  the  Price, 

Not  Counting  the  Cost 


To  be  sure,  there  have  been  economi¬ 
cal  privatizations  and  outsourcings.  State 
and  local  governments  have  in  many  in¬ 
stances  reported  success,  especially  when 
results  were  measured  using  an  activity- 
based  costing  (ABC)  approach.  In  a  March 
1997  privatization  study  conducted  by  the 
General  Accounting  Office  (GAO),  an  in¬ 
teresting  discovery  was  made  about  the 
role  played  by  the  price  of  labor  in 
privatization  projects.  When  laws  were  en¬ 


acted  that  required  private  firms  to  “com¬ 
pensate  [former  government  employees] 
at  a  rate  comparable  to  their  government 
pay  and  benefits,”  privatizations  dramati¬ 
cally  declined. 

In  the  last  analysis,  the  relative  and  so¬ 
cially  necessary  labor  price  makes  or 
breaks  most  privatization  and  outsourcing 
initiatives.  Each  case,  therefore,  must  be 
handled  individually,  since  privatization 
and  outsourcing  have  experienced  some 
profound  failures  and  false  starts,  and  usu¬ 
ally  entail  traumatic  work  force  transition 
(GAO,  1997,  p.  4).  For  instance,  in  a  ma¬ 
jor  outsourcing  flop  for  Unisys  Corpora¬ 
tion,  unanticipated  “labor-intensiveness” 
caused  an  early  termination  of  a  contract 
to  manage  the  health-care  program  for  the 
state  of  Florida’s  215,000  employees.  The 
contract  was  worth  $86  million  over  four 
years  and,  with  labor  savings  being  again 
the  financial  incentive  for  the  outsourcing 
venture  (“we  can  do  it  better,  cheaper”),  a 
Unisys  spokesman  admitted  that  the  con¬ 
tract  was  “an  aberration,  an  aggressive 
move”  and  one  that  proved  a  bridge  too 
far  (Caldwell,  1997). 

In  the  case  of  unregulated  privatization, 
the  long-term  problems  of  destroying  gov¬ 
ernment  as  a  steward  of  a  nation’s  re¬ 
sources  can  be  best  illustrated  in  Russia. 
As  Gary  Bertsch  and  Igor  Khripunov 
pointed  out  in  their  article  “Privatization 
Carries  Cost”  (1996),  the  “largest  prolif¬ 
eration  of  weapons  and  weapon-related 
technology  in  human  history”  is  beginning 
to  take  place  because  the  recently  priva¬ 
tized  high-tech  Russian  companies  have 
no  “nonproliferation  culture.”  Nor  has 
there  been  time  or  opportunity  to  build 
such  a  culture  (which  would  have  had  to 
overcome  the  impetus  of  history),  given 
that  Russia’s  private  sector  is  “locked  in  a 
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merciless  straggle  for  survival”(Bertsch  & 
Khripunov,  1996).  Privatization  has  driven 
the  former  Soviet  Union  and  its  former 
East  European  comrades  into  a  new  com¬ 
petition  with  America  for  the  title  of  lead¬ 
ing  arms  seller  and  producer.  The  ideo¬ 
logical  straggle  may  have  subsided,  but 
the  economic  straggle  continues. 

Start  the  Revolution  in  Business 
Affairs  Without  Me! _ 

Outsourcing  and  privatization,  if  con¬ 
sidered  on  a  case-by-case  basis  and  taken 
in  moderation,  can  be  beneficial.  It  is  defi¬ 
nitely  here  to  stay,  or,  if  we  forget  our  duty 
to  our  fellow  workers,  here  to  slay.  Ameri¬ 
can  companies  out-source  more  than  $100 
billion  a  year,  with  average  cost  savings 
of  10-15  percent;  the  federal  government 
spent  about  $114  billion  on  outsourcing 
during  1995  but  lacked  the  mechanisms 
(e.g.,  activity-based  costing  models)  for 
calculating  savings  (Lowry,  1996).  But  op¬ 
timism  springs  eternal:  Texas  Gov.  George 
W.  Bush,  son  of  the  former  president,  be¬ 
lieves  he  can  save  the  state  40  percent  of 
current  computer  costs  (as  much  as  $120 
million)  by  outsourcing  welfare  informa¬ 
tion  systems  work  (Hoffman,  1997b).  But 
massive  job  slashings  that  give  people  no 
place  to  turn,  dispensed  willy-nilly,  can 
create  economic  and  social  chaos. 

The  so-called  Revolution  in  Business 
Affairs  (which  is  the  complement  of  the 
technology-based  Revolution  in  Military 
Affairs)  was  initially  launched  to  help  De¬ 
fense  workers  conduct  the  Department’s 
affairs  more  economically  and  effec¬ 
tively — not  give  them  the  business.  De¬ 
fense  workers  are  just  regular  people:  they 
carry  debt,  pay  their  rents  and  mortgages. 


support  children  through  school.  If  DoD 
workers  are  something  other  than  “eco¬ 
nomically  viable,”  then  we  need  to  explore 
ways  to  make  them  so.  But  neither  national 
security  nor  “national  interests”  are  served 
by  arbitrarily  putting  huge  numbers  of 
them  on  the  cold  side  of  the  employer’s 
door  where  there  are  no  jobs  commensu¬ 
rate  with  their  old  paychecks  and  abilities. 
The  problem  with  out-of-work  Russian 
nuclear  specialists  and  frustrated,  unem¬ 
ployed  Eastern  European  mathematicians 
who  can  earn  more  as  authors  of  computer 
viruses  than  of  textbooks  should  not  be 
lessons  lost  on  us. 

The  noted  conservative  commentator 
Henry  Hazlitt  reminded  us  in  his  classic 
work  Econom¬ 


ics  In  One  Les¬ 
son  (1946),  that 
“in  studying  the 
effects  of  any 
given  economic 
proposal  we 
must  trace  not 


"If  DoD  workers 
are  something 
ether  than  "eco¬ 
nomically  viahle/^ 
then  we  need  to 
explore  ways  to 
make  them  so." 


merely  the  im¬ 


mediate  results 


but  the  results  in  the  long  ran,  not  merely 
the  primary  consequences  but  the  second¬ 
ary  consequences,  and  not  merely  the  ef¬ 
fects  on  some  special  group  but  the  effects 
on  everyone.”  Not  so  readily  examined  by 
the  “reformers”  seeking  the  Red  Badge  of 
Downsizing  is  the  aftermath  of  transform¬ 
ing  reasonably  paid  Defense  workers 
(motto:  “Together,  we  can  build  it”)  into 
pauperized  McEmployees  (motto:  “Would 
there  be  fries  with  that?”).  If  DoD  is  about 
people  always,  privatization  and  out¬ 
sourcing  must  be  outfitted  with  a  human 
face,  or  a  higher  economic  and  social  price 
will  be  paid  by  all,  not  far  enough  down 
the  line. 
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OPINION 


CHANGING  THE  WAY  WE 
ASSESS  LEADERSHIP 

Mary-io  Hall,  Ph,D, 


Defense  leaders  face  unprecedented  challenges  of  accelerating  change  in  a 
world  without  a  Cold  War.  The  technology  explosion  is  forcing  reduced  cycle 
times  as  acquisition  leaders  lead  the  way  to  “better,  faster,  and  cheaper.” 
Specific  initiatives  and  reforms  such  as  single  process  Initiative,  electrical 
combat/electronic  data  interchange  (EC/EDI),  cost  as  an  independent  variable, 
and  increased  emphasis  on  commercial  specifications  helped  accomplish  this. 
The  challenges,  however,  will  not  go  away.  The  acquisition  community  cannot 
meet  these  demands  simply  by  implementing  the  reform  efforts  of  the  Colleen 
Preston  (former  Deputy  Under  Secretary  of  Defense  [Acquisition  Reform])  era. 
To  ensure  that  cost,  schedule,  and  performance  are  continually  improved, 
change  must  be  inextricably  linked  to  both  the  “thinking”  and  the  “doing”  of 
the  IS.  Eliot  quote  below.  Change  is  required  at  the  organizational  level,  the 
team  level,  and  the  personal  level,  so  the  acquisition  community  can  operate 
effectively  and  efficiently  within  a  constrained  budget  and  with  fewer  people. 
To  effect  this  transformation,  leaders  must  lead  differently.  Einstein's  insight 
reflects  this  imperative;  “No  problem  can  be  solved  from  the  same 
consciousness  that  created  it;  we  must  learn  to  see  the  world  anew.”  Continuing 
to  do  what  we  have  always  done  will  only  get  us  what  we  already  have.  Better, 
faster,  and  cheaper  weapons  systems,  flexible  management  systems,  and 
empowered  integrated  product  teams  are  required  to  produce  new  results. 


...between  the  thinking  and  the  doing  lies  the  shadow. 

— T.  S.  Eliot 


To  operate  productively  in  an  envi¬ 
ronment  of  constant  change,  lead¬ 
ers  must  think  and  act  differently. 
Change  efforts,  such  as  the  acquisition 
reform  initiatives,  must  be  considered  part 
of  a  transformation  process,  not  an  “event” 
to  be  managed.  Leaders  who  are  effective 


in  the  change  wave  must  be  visionary, 
apply  a  systems  approach  to  their  prob¬ 
lem  solving,  encourage  out-of-the-box 
thinking,  appreciate  the  dynamics  of 
teams,  know  the  reality  of  change  man¬ 
agement,  and  operate  effectively  in  a  cha¬ 
otic  world.  The  capacity  to  lead  in  this 
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scenario  requires  the  skills  to  establish 
direction;  align  people,  systems,  and  re¬ 
sources;  and  motivate  and  inspire  follow¬ 
ers  (Kotter,  1996a).  Leaders  must  continu¬ 
ally  leam  and  enhance  their  management 
techniques  to  encourage  excellent  perfor¬ 
mance  in  a  complex  environment.  To  do 
this  leaders  must  lead  the  change  process. 
They  must  adapt  to  change  while  remain¬ 
ing  focused  on  the  strategic  direction. 
Peter  Vaill,  in  Learning  as  a  Way  of  Being 
(1996a),  calls  this  approach  to  continual, 
real-time  change  “leaderly  learning.” 

The  purpose  of  this  article  is  twofold. 
The  first  is  to  present  a  theory  of  leader¬ 
ship  for  the  circumstances  described 
above.  The  second  is  to  provide  manag¬ 
ers  with  a  method  for  assessing  their 
present  capability  and  building  personal 
mastery  associated  with  the  theory.  So  first 
I  will  present  a  theory  focusing  on  leader¬ 
ship  in  a  world  of  accelerating  change.  It 
provides  definitions  for  leadership  in 
terms  of  the  dimensions  that  research  in¬ 
dicates  are  necessary  for  leading  in  a  vola¬ 
tile,  uncertain,  ambiguous  world  where  the 
only  constant  is  faster  change.  Then  I  will 
provide  a  practical,  hands-on  tutorial  for 
self-directed,  intentional  learning  to  in¬ 
crease  capacity  for  the  type  of  leadership 
detailed  in  the  theoretical  model.  The 
framework  includes  techniques  for  assess¬ 
ing  present  leadership  capacity,  a  tool  for 
describing  and  demonstrating  this  capac¬ 
ity,  and  a  model  for  intentional  learning 
to  increase  capacity.  The  framework  helps 


eliminate  the  “shadow”  in  Eliot’s  quote 
by  presenting  tools  for  “doing.” 


Leadership  As  Learning 


My  research  for  assessing  personal 
leadership  capacity  began  several  years 
ago  in  my  role  as  organizational  change 
catalyst.  During  1994,  I  researched  and 
benchmarked  best  practices.  I  formalized 
findings  and  concepts  into  a  paper  that  was 
subsequently  presented  at  the  American 
Association  of  Higher  Education  Confer¬ 
ence  in  June  1996,  and  at  the  University 
of  Maryland  Symposium,  Leaders  and 
Change,  in  September  1996  (Hall,  1996). 
The  two  meetings  led  me  to  rethink  the 
leadership  content  presented  in  the  origi¬ 
nal  paper.  Based  on  further  research,  es¬ 
pecially  the  influence  of  Peter  Vaill  and 
John  Kotter  (who  has  written  extensively 
on  leading  change),  I  revised  the  lead¬ 
ership  content. 

As  expressed  by  Kotter  (1990, 1996a) 
there  is  a  critical  distinction  between  lead¬ 
ership  and  management.  He  states  that 
“Management  is  a  set  of  processes  [plan¬ 
ning,  budgeting,  organizing,  staffing, 
problem-solving,  etc.]  that  keep  a 
system.. .running”  (1996,  p.  25).  Leader¬ 
ship,  on  the  other  hand,  is  defining  the 
future,  aligning  the  people  (and  all  of  the 
systems  and  resources)  with  that  particu¬ 
lar  future  and  then  inspiring  people  to  cre¬ 
ate  that  future.  See  Appendix  A  for 
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Kotter’s  distinction  between  management 
and  leadership. 

While  both  management  and  leadership 
are  necessary,  the  change  and  complexity 
associated  witli  the  future  demands  that 
the  leadership  role  takes  precedence  over 
the  management  role.  This  concept  of" 
managerial  leadership  in  an  environment 
full  of  surprising,  novel,  messy  events 
demanding  attention  is  described  as  “per¬ 
manent  white  water”  (Vaill,  1989). 

Leading  in  this  environment  implies 
learning  new  ways  of  operating  and  be¬ 
having  based  on  the  demands  and  reality 
of  a  changing  context.  As  Farkas  and 
Wetlaufer  wrote  in  the  Harvard  Business 
Review  (1996),  “CEOs  must  learn  on  the 
job  how  to  lead  a  company,  and  they  must 
learn  while  every  stockholder  is  watch¬ 
ing.”  Dixon  (1996,  p.  4)  references  Rob¬ 
ert  Kegan’s  work.  In  Over  Our  Head,  and 
states:  “People  find  themselves  in  over 
their  heads  much  of  the  time.  The  organi¬ 
zations  in  which  people  work  are  also  in 
over  their  heads.  They  are  actively  search¬ 
ing  for  new  ways  of  acting  and  interact¬ 
ing.” 

Change  is  not  only  a  phenomenon  as¬ 
sociated  with  organizations  desiring  to  be 
more  customer-driven,  more  team  ori¬ 
ented,  and  more  inclined  to  make  deci¬ 
sions  based  on  data.  Change  is  pervasive 
in  all  facets  of  our  present  and  future 
world,  from  demographics,  to  technology, 
to  global  issues.  Living  in  the  present  and 
future  world  successfully  requires  extraor¬ 
dinary  changes  in  knowledge,  skills,  atti¬ 
tudes,  and  behaviors.  Gaining  this  new 
capacity  requires  a  focused,  conscious 
awareness  of  the  learning  process  and  a 
dedication  to  improve  intentional,  per¬ 
sonal  learning  through  planning  and  self- 
direction. 


To  develop  self-planned,  intentional 
learning,  individuals  need  to  understand 
the  purpose  for  learning  (the  why  of  learn¬ 
ing),  have  strategies,  methods,  and  re¬ 
sources  for  learning  (the  how  of  learning), 
and  they  need  to  be  able  to  comprehend 
the  content  (the  what  of  learning).  They 
need  to  have  the  skills  to  assess  present 
capacity  and  establish  specific  objectives 
to  enable  future  learning.  The  opportunity 
for  human  learning  occurs  every  day. 
However,  for  learning  to  translate  into  new 
skills,  behaviors,  and  competencies  on  the 
job,  learning  must  be  purposeful,  directed, 
and  intentional. 

The  original  version  of  this  work  pre¬ 
sents  the  primary  skills  of  leaders  of 
change  as:  focus  (vision,  strategic  goals, 
purpose),  direction  (values,  communica¬ 
tion,  stretch  goals,  a  customer  focus,  us¬ 
ing  data  to  drive  decisions),  guidance  (pro¬ 
cess  improvement,  use  of  tools,  teaming 
continual  improvements),  and  support 
(consistency  in  support  systems,  encour¬ 


aging  innova¬ 


tion,  etc.).  The 
revised  version 
provides  five 
dimensions  for 
leadership;  the 
major  differ- 


"While  both  man-  . 
agement  and  lead- 
ei'ship  are  neces¬ 
sary,  the  change  : ; 
and  complexity 
associated  with  the 


ences  being  pri-  future  demands  that 


marily  in  the 
emphasis  on 
personal  learn¬ 
ing  and  manag- 


the  leadership  ■‘•l« 
takes  precedence 
over  the  manage¬ 
ment  role." 


ing  change. 


Here  I  describe  the  dimensions  of  leader¬ 


ship  as:  personal  learning;  establishing 
direction;  aligning  people,  systems,  and 
resources;  motivating  and  inspiring  fol¬ 
lowers;  and  managing  change.  The  revised 
leadership  context  takes  into  account  the 
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complexity  inherent  in  present  and  future 
leadership,  especially  in  the  face  of  the 
“permanent  white  water”  characteristic  of 
acquisition  reform. 

^KSONAL  Learning 


The  problem  with  real-time,  self-di¬ 
rected  learning  for  leaders  is  that  it  is  as¬ 
sumed  that  leaders  know  more  than  oth¬ 
ers.  Today  the  rate,  volume,  and  variety 
of  change  is  increasing  at  such  a  rate  that 
leaders  are  in  a  constant  state  of  learning — 
they  do  not  have  the  luxury  of  prior  expe¬ 
rience  and  knowledge.  Vaill  calls  this 
“leading  a  learning  process”  (1996b,  p.  2). 
He  goes  on  to  postulate  a  learning  premise 
(1996b,  p.  8). 

In  dynamic,  rapidly  changing 
situations  of  “permanent  white 
water,”  where  unprecedented 
challenges  and  crisis  are  occur¬ 
ring  continually,  the  ability  to 
learn  effectively  is  the  primary 
(in)competence.  Therefore,  effec¬ 
tive  managerial  leadership  in  such 
situations  cannot  ever  be  suffi¬ 
ciently  learned. 

Effective  managerial  leadership 
in  such  situations  is  learning. 

The  premise  is  profound  in  that  it  rec¬ 
ognizes  that  the  purpose  of  education  is 
not  to  teach  the  present  reality,  but  rather, 
to  create  an  environment  where  everyone 
is  enabled  to  learn  about  their  learning  and 
to  learn  methods,  strategies,  and  tools  to 
improve  their  unique  learning  process.  The 
question  Vaill  puts  forth  is;  “To  what  ex¬ 
tent  are  the  individuals  who  are  in  posi¬ 


tions  of  leadership. ..focusing  (and  being 
helped  to  focus)  on  their  own  learning 
abilities  on  the  subject  of  leadership?” 
(1996b,  p.  9).  Thus,  leadership  is  about 
learning.  Vaill  (1996b)  posits  that  reflec¬ 
tion  is  an  integral  aspect  of  this  process 
and  that  a  reflective  learner  “...learns  about 
ourselves  as  learners...”  (p.  84).  He  fur¬ 
ther  adds  that  the  reflective  learning  sys¬ 
tem  relies  on  self  direction,  creativity,  ex¬ 
pressiveness,  feeling  the  meaning,  learn¬ 
ing  on-line,  and  continuous  learning. 

The  self-directed  mode  of  learning  is 
the  degree  to  which  intentional  learning 
is  guided  by  personal  choice,  not  depen¬ 
dence  on  others.  “In  reflexive  activities  we 
are  trying  to  understand  how  to  increase 
our  personal  sense  of  ownership  in  our 
learning”  (Vaill,  1996a,  p.  87).  Creative 
learning  implies  that  we  are  going  into  un¬ 
explored  territory,  not  just  doing  what  oth¬ 
ers  have  done  before.  Expressive  learn¬ 
ing  is  being  engaged  actively,  not  merely 
absorbing.  Feeling  learning  is  knowing  the 
gut  reaction  to  the  learning.  It  is  the  emo¬ 
tional  element  that  engages  the  brain  to 
an  extent  not  possible  without  emotion. 
On-line  learning  broadens  our  learning 
because  we  are  consciously  and  intention¬ 
ally  learning  new  subjects,  new  topics,  and 
exploring  areas.  This  implies  a  willingness 
and  openness  to  learn  about  a  variety  of 
options  rather  than  sticking  to  the  known. 
This  means  experiential  learning,  not  pas¬ 
sive  listening.  Continual  learning  implies 
continual  intentional  learning,  i.e.,  by  de¬ 
sign  and  consciousness,  not  ad  hoc  and 
by  osmosis. 

Learning  can  be  part  of  every  work  pro¬ 
cess.  When  it  is,  it  continually  stretches 
the  people  involved  in  the  learning  and 
expands  the  capability  of  the  organization. 
Peter  Senge  states  (1990,  p.  14): 
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Real  learning  gets  to  the  heart  of 
what  it  means  to  be  human. 
Through  learning  we  re-create 
ourselves.  Through  learning  we 
become  able  to  do  something  we 
never  were  able  to  do.  Through 
learning,  we  re-perceive  the 
world  and  our  relationship  to  it. 
Through  learning  we  extend  our 
capacity  to  create,  to  be  part  of 
the  generative  process  of  life. 


Establishing  Direction 


Establishing  direction  implies  a  clear 
vision  for  the  future  and  strategies  to  get 
to  the  vision.  The  purpose  for  establish¬ 
ing  direction  is  to  transform  the  organiza¬ 
tion  into  something  different  than  its 
present  state.  The  purpose  is  not  to  have 
detailed  plans  that  occupy  shelf  space  and 
are  posted  on  the  World  Wide  Web.  For 
the  acquisition  community,  establishing 
direction  implies  a  business  approach  with 
the  tenets  of  the  Government  Performance 
and  Results  Act  and  Acquisition  Reform 
inherent  in  every  aspect  of  the  operation. 
The  primary  skills  needed  by  leaders  to 
establish  direction  are  creating  a  vision 
and  articulating  that  vision  to  the  extent 
that  the  organizational  leadership  is  able 
to  develop  strategies  to  realize  the  vision 
(Kotter,  1990).  This  vision  is  a  clear  pic¬ 
ture  of  a  future  state  that  looks  at  the  or¬ 
ganization  as  a  whole,  integrated  system, 
not  a  group  of  individual  parts  or  vertical 
stovepipes.  Setting  and  communicating  a 
clear  picture  of  the  future  focuses  on  out¬ 
comes  that  are  consistent  with  the  require¬ 
ments  of  present  and  future  customers. 
Progress  toward  the  vision  is  measured 
periodically  with  performance  results. 


Leading  in  this  manner  promotes  innova¬ 
tion  by  everyone  and  models  integrity 
through  open  communication  consistent 
with  behavior,  the  cornerstone  of  a  high- 
performance,  agile  organization. 


Aligning  People,  Systems, 
AND  Resources 


'^Establishing  direc¬ 
tion  implies  a  clear 
visien  for  the  future 
and  strategies  to 
get  to  the  visien." 


Aligning  people  with  vision  and  strat¬ 
egies  is  easier  said  than  done.  It  requires 
extensive  communication  in  a  variety  of 
formats  (e.g.,  verbal,  written,  electronic, 
personal).  It  also  requires  “buy-in”  from 
everyone  for  the  vision  and  commitment 
to  its  achievement  and  success.  This  im¬ 
plies  two-way  communication.  Listening 
is  most  impor¬ 
tant  in  creating 
an  environment 
in  which  all  are 
enabled  to  em¬ 
power  them¬ 
selves.  Asking 
pertinent  and 

thought-provoking  questions  about  the 
system  is  as  important  as  providing  solu¬ 
tions.  Communication  is  not  just  verbal 
and  written,  it  includes  modeling  core  val¬ 
ues  of  the  organization  such  as  teaming, 
trust,  empowerment,  and  excellence. 
Communication  builds  trust  within  and 
among  all  people  by  actions  that  match 
words,  thus  instilling  integrity  in  the  sys¬ 
tem. 

While  Kotter  focuses  primarily  on 
aligning  people,  research  also  indicates 
that  systems  and  resources  must  be  aligned 
with  the  vision  and  the  strategies  as  a  pre¬ 
cursor  for  involvement  and  commitment. 
For  example,  if  reward  and  recognition 
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systems  do  not  support  the  vision,  values, 
and  strategies,  it  is  difficult  to  inspire  and 
motivate  people  to  continually  improve 
and  change. 

Motivating  and  Inspiring  Foilowers 

Motivating  and  inspiring  others  is  nec¬ 
essary  to  keep  the  change  journey  on  track 
and  progressing.  Kotter  states  (1990,  p. 
61); 

...direction  setting  identifies  an 
appropriate  path  for  movement, 
effective  alignment  gets  people 
moving  down  that  path,  and  a 
successful  motivational  effort  as¬ 
sures  that  those  people  will  have 
the  energy  to  overcome  obstacles 
in  their  way. 

The  change  journey  has  barriers,  ob¬ 
stacles,  challenges,  and  hurdles  that  con¬ 
tinually  surface.  Being  able  to  stay  focused 
on  the  vision  and  strategies  when  these 
barriers  surface  is  like  changing  a  tire 
;  while  the  car  is 

"Motivating  and  ;  ^  "oo^ng  down 
inspiring  others  is  interstate  at 

necessary  to  keep  60  mph.  Inspir- 

the  change  ieurney  ing  and  moti¬ 
on  track  and  pro-  vating  others  in- 

gressing."  volves  accept¬ 

ing  people  for 
their  unique  contributions,  supporting  in¬ 
novation  and  risk  taking,  and  being  con¬ 
stantly  self-motivated.  It  is  inherent  that 
the  diversity  of  the  workforce  in  terms  of 
race,  gender,  learning  style,  personality 
type,  functional  specialty,  service,  grade, 
and  rank,  influences  the  efficacy  and  pro¬ 


ductivity  of  integrated  product  teams. 
However,  for  the  impact  to  be  positive, 
the  leader  must  motivate  and  inspire  all 
team  members,  not  just  a  few. 

Managing  Change 


Managers  must  lead  to  the  vision 
through  unprecedented  challenges  and 
change;  therefore,  the  effective  leader 
must  manage  the  change  as  a  never-end¬ 
ing  process,  not  as  a  specific  event  or  ac¬ 
tivity.  While  it  behooves  leaders  to  focus 
on  the  present  change,  it  is  more  impor¬ 
tant  that  leaders  understand  and  work  with 
others  on  the  process  of  continual  change. 
The  capacity  to  manage  change  is  best 
summarized  by  Kotter  (1996a)  and  in¬ 
cludes:  establishing  a  sense  of  urgency, 
creating  the  guiding  coalition,  developing 
a  vision  and  strategy,  communicating  the 
change  vision,  empowering  broad-based 
action,  generating  short-term  wins,  con¬ 
solidating  gains,  and  producing  more 
change  and  anchoring  new  approaches  in 
the  culture  (see  Appendix  B  for  further 
breakdown). 

While  some  of  the  skills,  competencies, 
and  behaviors  needed  to  lead  a  focused 
change  process  are  the  same  general  skills, 
competencies,  and  behaviors  needed  by 
leaders  in  a  more  stable  environment  (for 
example,  establishing  direction),  Kotter’s 
managing  change  category  is  purposefully 
presented  intact  because  of  the  thorough¬ 
ness  and  acceptability  of  the  model.  Ad¬ 
ditionally,  this  model  is  compatible  with 
the  classic  three-step  procedure  of  change 
model  (unfreezing,  movement,  and  re¬ 
freezing)  presented  by  Kurt  Lewin  (1951). 
Kotter’s  (1996b,  p.  59)  research  docu¬ 
ments  that  not  doing  any  one  of  the  ac- 
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tions  results  in  a  change  effort  that  is  not 
as  successful  as  expected:  “...the  change 
process  goes  through  a  series  of  phases 
that,  in  total,  usually  require  a  consider¬ 
able  length  of  time.  Skipping  steps  cre¬ 
ates  only  the  illusion  of  speed  and  never 
produces  a  satisfying  result.” 

Assessment  Using  a  Capacity  Matrix 

Identifying  the  competencies,  the  skills, 
and  the  behaviors  to  lead  organizational 
change  is  the  first  step  in  the  learning  pro¬ 
cess.  The  individual’s  capacity  in  each  of 
the  five  leadership  dimensions  areas  must 
then  be  assessed  to  determine  present  ca¬ 
pacity.  Goals  and  a  plan  to  reach  the  goals 
must  then  be  developed.  To  get  results  and 
build  capacity,  the  plan  must  be  imple¬ 
mented  and  assessed.  This  article  uses 
David  Langford’s  “capacity  matrix”  as  the 
tool  (Appendix  C)  to  assess  personal  ca¬ 
pacity  to  lead  change  in  a  volatile  world 
(1995).  The  competencies,  behaviors,  and 
skills  from  the  five  leadership  dimensions 
are  loaded  into  the  tool. 

According  to  Langford,  the  capacity 
matrix  gives  responsibility  for  both  evalu¬ 
ation  and  learning  to  the  individual.  In  the 
matrix  the  horizontal  axis  depicts  the 
skills,  competencies,  and  behaviors  iden¬ 
tified  as  the  five  dimensions  of  leadership. 
The  vertical  axis  shows  the  learning  lev¬ 
els  broken  down  by  a  variation  of  Bloom’s 
Learning  Taxonomy,  developed  by 
Langford  and  Myron  Tribus  (Langford, 
1995).  These  categories  are  knowledge, 
know-how,  and  wisdom. 

As  described  by  Langford  (1995), 
knowledge  includes  obtaining  information 
and  the  ability  to  recall  it,  especially  at 
the  appropriate  time  (for  example,  re¬ 


sponding  to  test  questions  about  a  topic). 
Knowledge  can  be  demonstrated  by:  nam¬ 
ing,  listing,  defining,  and  answering:  who, 
what,  where,  when,  how  many,  and  how 
much? 

Know-how  is  the  ability  to  understand 
or  comprehend  and  apply  knowledge  and 
to  analyze  information.  Comprehension 
can  be  demonstrated  by:  giving  examples; 
telling  what  probably  will  happen;  telling 
what  caused  an  incident;  comparing;  con¬ 
trasting;  presenting  an  idea  in  your  own 
words;  and  using  terminology  associated 
with  the  concept  in  a  meaningful  way. 

Application  is  the  ability  to  use  ideas, 
concepts,  methods,  and  principles  in  new 
situations.  The  process  of  applying  a  skill 
or  competence  is  demonstrated  by  solv¬ 
ing  challenges,  ; 

generalizing  ..We„fify|„g  the 
from  one  situa-  competencies,  the 

tion  to  another,  Ihe  be- 

and  probing  for  i  hovlors  to  lend 
answers.  organizational 

Analysis  is  change  Is  the  first 
methodically  »*®l»  *1*®  learning 

examining  ideas  P»'ecess." 
and  concepts 

and  separating  them  into  parts  or  basic 
principles.  Analysis  requires  knowledge, 
comprehension,  and  application.  In  the 
Langford/Tribus  model,  the  wisdom  cat¬ 
egory  includes  judgment  (discerning), 
synthesis  (creating),  and  appreciation  or 
evaluation.  Judgment  includes  comparing, 
assessing,  reflecting,  observing,  thinking, 
correlating,  and  focusing. 

Synthesis  is  the  ability  to  put  together 
parts  and  elements  into  a  unified  whole, 
which  requires  original  and  creative  think¬ 
ing.  It  includes  constructing  a  model,  cre¬ 
ating  a  plan,  or  arranging  pieces  together 
that  probably  were  not  previously  joined. 
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Appreciation  is  the  ability  to  acknowl¬ 
edge  or  judge  the  value  of  ideas,  proce¬ 
dures,  and  methods  using  appropriate  cri¬ 
teria,  such  as  usefulness  or  effectiveness. 
It  is  the  ability  to  predict,  measure,  and 
select.  It  also  includes  substantiating  with 
facts,  theories,  and  observations. 

The  capacity  matrix,  using  these  levels 
of  learning,  is  a  living  document  that  is 
regularly  updated  by  the  learner.  Shading, 
color-coding  or  other  indicators  are  used 
to  assess  personal  capacity  in  a  particular 
skill,  competency,  or  behavior. 

Documentation  Using  a  Portfolio 

Self  assessment  of  one’s  individual  ca¬ 
pacity  to  lead  change  using  the  capacity 
matrix  is  a  start.  But  as  W.  Edwards 
Deming  (1993)  frequently  asked,  “How 

do  you  know 

''The  importance  Of  a 

"reality  check"  by 

soliciting  data  from  rate?”  Personal 

a  variety  of  sources  learning  implies 

cannot  be  overem*  actually  learn- 

phasized."  ing  how  to  learn 

and  continually 
improving  that  process.  Learning  happens 
in  a  variety  of  ways.  It  can  be  through  ex¬ 
perience,  modeling,  and  inputs  such  as  lec¬ 
tures,  videos,  and  texts  (Langford,  1995, 
a-1 1).  Part  of  the  personal  change  process 
is  understanding  the  effectiveness  of  the 
different  ways  one  personally  learns. 

One’s  measure  of  personal  learning  is 
a  portfolio  documenting,  defending,  and 
describing  present  capacity.  This  portfo¬ 
lio  can  be  a  handwritten  notebook  with 
tabs  for  each  of  the  skills,  behaviors,  and 
competencies,  or  it  can  be  electronic  with 
hyperlink  text  and  multimedia  portions. 


Documentation  includes  storyboards  from 
projects,  feedback  from  others,  reports, 
videos  of  presentations,  or  personal  docu¬ 
mentation  of  the  learning  process  (for  ex¬ 
ample,  a  learning  journal  that  substanti¬ 
ates  the  assessment  level  on  the  capacity 
matrix).  The  capacity  portfolio  documents 
what  you  presently  know  with  examples 
and  answers  the  questions  “How  do  I  know 
I  know,  and  at  what  level  or  competency?” 

The  portfolio  also  reflects  documenta¬ 
tion  of  what  others  think  about  your  ca¬ 
pacity  level  as  well  as  what  you  think.  One 
strategy  for  determining  what  others  think 
is  customer  feedback.  Mechanisms  for 
receiving  feedback  include  climate  sur¬ 
veys  of  the  organization  such  as  the 
Campbell  Organizational  Survey,  feed¬ 
back  from  work  processes,  letters,  certifi¬ 
cates,  and  Multirater  Assessment  (360° 
Feedback).  The  importance  of  a  “reality 
check”  by  soliciting  data  from  a  variety 
of  sources  cannot  be  overemphasized. 

Intentional  Learning 


Having  completed  an  assessment  of 
your  capacity  as  a  leader  of  change,  docu¬ 
mented  and  described  your  skills,  knowl¬ 
edge,  and  activities  in  a  portfolio,  how  do 
you  continue  intentional,  self-directed 
learning?  A  model  developed  by  Wick  and 
Leon  (1993)  and  used  extensively  by  in¬ 
dustry,  is  called  SMART  learning  (select, 
map,  act,  review,  and  target).  A  modifica¬ 
tion  of  this  model  includes  the  following 
steps: 

Step  1  is  to  select  a  goal  based  on 
present  and  future  importance  to  the  or¬ 
ganization.  Identifying  one  goal  at  the  time 
and  working  on  that  particular  goal  for 
approximately  4  months  is  the  recom- 
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mended  strategy.  Selection  of  a  goal  is 
based  on  both  the  gaps  in  the  capacity 
matrix  and  personal  analysis. 

Step  2  is  to  map  out  achievement  of  the 
goal  with  a  detailed  learning  map.  Con¬ 
centrate  on  the  purpose  and  the  results  si¬ 
multaneously.  Incorporate  planning  and 
management  tools  to  quantify  as  much  of 
the  plan  as  possible.  A  suggested  format 
for  the  map  includes; 

•  a  learning  goal; 

•  action  steps  with  milestone  chart  (be 
specific  and  detailed); 

•  resources  needed  (this  could  be  a  ma¬ 
trix  of  people,  materials,  and  re¬ 
sources); 

•  barriers  anticipated  (force  field  analy¬ 
sis); 

•  measurement  of  result  (from  capacity 
matrix  levels); 

•  future  organization  benefits; 

•  future  personal  benefits;  and 

•  a  planned  completion  date. 

Step  3  is  to  act  on  the  plan.  Determine 
progress  on  a  monthly  basis.  Analyze  both 
the  content  and  the  process  of  the  learn¬ 
ing.  Make  mid-course  corrections  in  the 
plan.  Recommendations  to  help  stay  on 
track  include  using  learning  partners/men¬ 
tors,  visual  reminders  adaptable  to  particu¬ 
lar  calendars  or  daytimers  and  learning 
journals  for  reflection,  lessons  learned, 
idea  development,  and  linking  new  infor¬ 
mation  with  present  knowledge. 


Step  4  is  to  review  and  evaluate  learn¬ 
ing  and  the  learning  process.  Continually 
reflecting  on  the  learning  process  is  im¬ 
portant  to  make  connections  with  other 
learning  and  to 

transfer  the  new  ^Ref  lecting  and  ^ 

learning  to  on-  questioning  tacit  ; ; 
the-job  practice,  assumptions  helps 
Reflecting  and  defino  and  clarify 
questioning  ene's  bellel  sys- 
tacit  assump- 
tions  helps  de¬ 
fine  and  clarify  one’s  belief  system.  Us¬ 
ing  the  new  learning  is  imperative;  thus 
finding  practice  opportunities  is  a  constant 
need. 

Step  5  is  to  target  the  next  learning  goal. 
This  implies  going  back  to  the  learning 
purpose  and  the  capacity  matrix.  This 
phase  in  the  learning  triggers  a  new  learn¬ 
ing  cycle  and  repeating  the  assessment, 
documentation,  planning,  and  learning  se¬ 
quence.  This  cycle  for  building  personal 
capacity  increases  leadership  skills  and 
promotes  higher  levels  of  learning.  It  mod¬ 
els  leaderly  learning. 

SUMAURY 


The  bottom  line  in  assessing  personal 
leadership  effectiveness  is  improving  per¬ 
sonal  capacity  to  lead  in  the  complex, 
changing  world  of  permanent  white  wa¬ 
ter,  regardless  of  the  present  acquisition 
reform  initiative.  This  implies  improving 
your  skills,  competencies,  and  behaviors 
through  intentional,  self-directed,  personal 
learning,  and  it  includes  having  the  skills 
to  establish  direction  for  a  work  group, 
team,  or  organization.  This  leadership  skill 
also  assumes  having  the  capacity  to  align 
people,  systems,  and  resources  toward  a 
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common  vision;  motivate  and  inspire  all 
members;  and  successfully  manage 
change.  The  assessment,  documentation, 
and  planning  for  learning  are  simply  ac¬ 
tivities  if  the  results  do  not  improve  lead¬ 
ership  and  contribute  to  acquisition  sys¬ 
tems  that  meet  the  requirements  of  the 
warfighters. 

Commitment  to  improve  one’s  personal 
capacity  to  lead  is  generally  based  on  in¬ 
trinsic  motivation.  It  is,  however,  the  pri¬ 
mary  role  of  the  leader  of  change.  It  is 
impossible  for  leaders  to  build  a  team  or 
an  organization  into  something  different 
from  themselves  (Clemmer,  1995).  For 
leaders  to  expect  the  organization  to 
change,  they  must  understand  the  change 
process  and  how  people  react  to  change. 
For  leaders  to  expect  the  organization  to 
improve,  they  must  improve  themselves 
using  a  disciplined  approach.  For  leaders 
to  expect  everyone  to  contribute  to  the 
vision  and  mission,  they  must  personally 


contribute  to  the  vision  and  mission.  For 
an  organization  to  move  toward  its  vision, 
all  systems  must  be  aligned  and  individu¬ 
als  must  be  intrinsically  motivated  and 
inspired. 

The  greatest  loss  in  any  organization  is 
the  inability  to  tap  the  full  measure  of  hu¬ 
man  potential.  The  leadership  role  in 
today’s  organizations  places  great  empha¬ 
sis  on  transforming  the  enterprise  through 
others.  Leaders  need  to  engage  100  per¬ 
cent  of  their  members  in  producing  out¬ 
comes  required  by  customers.  In  the  ac¬ 
quisition  community  this  means  weapon 
systems  for  warfighters  that  meet  cost, 
schedule,  and  performance  requirements 
in  a  downsized,  budget-constrained  envi¬ 
ronment.  To  meet  this  challenge,  leaders 
must  model  self-directed,  intentional,  real¬ 
time  learning.  They  then  will  eliminate  the 
shadow  between  thinking  and  doing  in 
personally  mastering  leaderly  learning. 


The  statements  of  fact  or  opinion  appearing  in  this  document  are  soieiy 
attributable  to  the  authors  and  are  not  necessarily  endorsed  by  the  Department 
of  Defense  or  the  Defense  Acquisition  University. 


402 


Changing  the  Way  We  Assess  Leadership 


References 


Clemmer,  J.  (1995).  Pathways  to  perfor¬ 
mance.  Rocklin,  CA:  PRIMA  Publish¬ 
ing. 

Deming,  W.E.  (1993).  The  new  econom¬ 
ics.  Cambridge,  MA:  Massachusetts 
Institute  of  Technology. 

Dixon,  N.  M.  (1996).  Perspectives  on  dia¬ 
logue.  Greensboro,  NC:  Center  for  Cre¬ 
ative  Leadership. 

Farkas,  C.M.,  &  Wetlaufer,  S.  (1996,  May- 
June).  The  ways  chief  executive  offic¬ 
ers  lead.  Harvard  Business  Review, 
110-122. 

Hall,  M.  (1996).  Prceedings:  The  1996 
NTL  Conference:  Leaders  and  Change. 
“Increasing  Leadership  Capacity  to 
Transform  Organizations”  College 
Park,  MD.  The  University  of  Mary¬ 
land. 

Kotter,  J.  (1996a).  Leading  change.  Bos¬ 
ton:  Harvard  Business  School  Press. 

Kotter,  J.  (1996b,  September).  Leading 
change:  Why  transformation  efforts 
fail.  Harvard  Business  Review,  59-67. 


Kotter,  J.  (1990).  A  force  for  change.  New 
York:  The  Free  Press. 

Langford,  D.  (1994).  Quality  Learning:  A 
Manual  for  Seminars  (Version  3.0). 
Billings,  MT:  Langford  International. 

Lewin,  K.  (1951).  Field  theory  in  social 
sciences.  New  York:  Harper  &  Broth¬ 
ers. 

Senge,  P.  (1990).  The  fifth  discipline:  The 
art  and  practice  of  the  learning  orga¬ 
nization.  New  York:  Doubleday. 

Vaill,  P.  (1989).  Managing  as  a  perform¬ 
ing  art.  San  Francisco:  Jossey-Bass. 

Vaill,  P.  (1996a).  Learning  as  a  way  of 
being.  San  Francisco:  Jossey-Bass. 

Vaill,  P.  (1996b).  Leadership  is  not 
learned:  It  is  learning.  In  Proceedings 
from  the  1996  NLI  Conference:  Lead¬ 
ers  of  Change. 

Wick,  C.  W,  &  Leon,  L.  S.  (1993).  The 
learning  edge.  New  York:  McGraw- 
Hill,  Inc. 


403 


Atquhition  Review  Quarterly — Fall  1997 


Appendix  A 


KonEiKs  Comparison  of  Management  and  Leadership 


Creating  an 
agenda 


Developing  a 
human 
network  for 
achieving  the 
agenda 


Execution 


Outcomes 


Management  Leadership 


Planning  and  budgeting: 
Establishing  detailed  steps  and 
timetables  for  achieving 
needed  results,  and  then 
allocating  the  resources 
necessary  to  make  that  happen. 

Organizing  and  staffing: 
Establishing  some  structure  for 
accomplishing  plan 
requirements  staffing  that 
stmcture  with  individuals, 
delegating  responsibility  and 
authority  for  carrying  out  the 
plan,  providing  policies  and 
procedures  to  help  guide 
people  and  creating  methods  or 
systems  to  monitor 
implementation. 

Controlling  and  problem 
solving:  Monitoring  results 
versus  plan  in  some  detail, 
identifying  deviations,  and  then 
planning  and  organizing  to 
solve  these  problems. 

Produces  a  degree  of 
predictability  and  order,  and 
has  the  potential  to  consistently 
produce  key  results  expected 
by  various  stakeholders  (e.g., 
for  customers,  always  being  on 
time;  for  stockholders,  being 
on  budget). 


Establishing  direction: 
Developing  a  vision  of  the 
future,  often  the  distant  future, 
and  devising  strategies  for 
producing  the  changes  needed 
to  achieve  that  vision. 

Aligning  people: 
Communicating  the  direction 
by  words  and  deeds  to  all 
those  whose  cooperation  may 
be  needed  so  as  to  influence 
the  creation  of  teams  and 
coalitions  that  understand  the 
vision  and  strategies,  and 
accept  their  validity. 


Motivating  and  inspiring: 
Energizing  people  to 
overcome  major  political, 
bureaucratic,  and  resource 
barriers  to  change  by 
satisfying  very  basic,  but  often 
unfulfilled,  human  needs. 

Produces  change,  often  to  a 
dramatic  degree,  and  has  the 
potential  to  produce  extremely 
useful  change  (e.g.,  new 
products  that  customers  want, 
new  approaches  to  labor 
relations  that  help  make  a  firm 
more  competitive). 


Source:  Taken  from  Kotter,  J.  R  (1990).  A  Force  for  Change.  New  York:  The  Free  Press. 
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_ Appendix  B _ 

The  Eight-Stage  Process  of  Creating  Major  Change 


Source:  Taken  from  Kotter,  J.  P.  (1995,  March-April).  Harvard  Business  Review. 
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Tabie  2.  Capacity  Matrix  for  Increasing  Personae  Leadership  Capacity 


Changing  the  Way  IVe  Assess  leadership 


407 


Table  3.  Opacity  Matrix  for  Increasing  Personal  Leadership  Opacity 
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Table  4.  Capacity  Matrix  for  Increasing  Personal  Leadership  Capacity 
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Table  5.  Capacity  Matrix  for  Increasing  Personal  Ieadership  Capacity 
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LESSONS  LEARNED 


THE  PHOENIX  RISES 


Col  Randy  Davis,  USAF,  ITC  Bill  Phillips,  USA, 
and  It  Col  Bud  Vazquez,  USAF 


The  story  of  how  this  acquisition  program  rebounded  from  the  brink  of  extinction 
to  a  model  of  reduced-cost  and  ahead-of-schedule  production  illustrates  how 
determination,  the  use  of  integrated  product  teams,  the  program  executive 
officer  system,  and  the  process  approach  to  manufacturing  can  produce 
results. 


Truth  is  a  function  of  time. 

— Brig  Gen  Ron  Kadish 
C-17  System  Program  Director 

1993 


Secretary  of  the  Air  Force,  Dr. 
Sheila  Widnall,  used  to  joke  that 
the  phrase,  “the  troubled  C-17 
program”  was  really  all  one  word.  Accord¬ 
ingly,  there  are  many  accounts  describing 
how  the  C-17  “Globemaster  III”  airlifter 
program  got  into  trouble.  Surprisingly,  no 
one  has  tried  to  capture  the  specifics  of 
the  even  more  remarkable  story  of  how 
the  C-17  program  got  out  of  trouble.  This 
article  will  tell  that  story. 

We  will  begin  with  a  short  description 
of  the  aircraft  and  the  requirement  for  it. 
Then,  to  put  the  ultimate  success  of  this 
major  acquisition  program  in  proper  con¬ 
text,  we  provide  a  brief  review  of  the 
program’s  troubled  past.  Following  this 
review,  we’ll  cover  the  salient  events — in 
the  Pentagon,  program  offices,  and  the 


McDonnell  Douglas  plant — ^that  substan¬ 
tially  contributed  to  the  remarkable  turn¬ 
around.  We  conclude  with  an  in-depth 
look  at  lessons  learned  that  could  benefit 
other  programs. 


The  Aircraft  and 
The  Requirement  For  It 


The  C-17  aircraft  program  is  the  U.S. 
Air  Force’s  effort  to  develop  a  modem 
airlifter  capable  of  meeting  the  worldwide 
air  mobility  needs  of  the  Department  of 
Defense  (DoD).  In  the  late  1970s,  and  af¬ 
ter  the  cancellation  of  the  YC-1 4  and  Y C- 
15  programs,  the  need  for  an  aircraft  ca¬ 
pable  of  carrying  large  payloads  to  aus- 
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tere  fields  remained.  The  formal  require¬ 
ment  for  the  C-17  was  thus  identified  in 
1980.  The  aircraft  was  specifically  de¬ 
signed  to  carry  modem  combat  weapons 
of  U.S.  ground  forces  directly  into  airfields 
near  the  conflict.  This  capability  is  known 
as  “direct  delivery”;  a  strategic  airlifter  is 
able  to  deliver  to  tactical  assembly  areas 
without  an  intermediate  stop.  Perhaps 
most  important,  the  C-17  will  also  pro¬ 
vide  a  way  to  move  “outsize”  cargo  (very 
large  equipment  like  the  M-IA  Abrams 
tank,  or  the  Multiple  Launch  Rocket  Sys¬ 
tem — equipment  that  cannot  fit  on  today’s 
C-141s  or  C-130s)  for  inter-  and  intra¬ 
theater  airlift.  The  direct  delivery  dimen¬ 
sion  with  an  outsize  airdrop  capability  will 
serve  to  significantly  enhance  airlift  sup¬ 
port  to  combat  forces  in  the  field  and  im¬ 
prove  the  mobility  of  general  purpose 
forces. 

The  aircraft  is  a  high-wing,  T-tailed  air¬ 
lift  aircraft.  It  is  powered  by  four  Pratt  and 
Whitney  PW-2040  engines  with  the  mili¬ 
tary  designation  F-117.  The  engines  are 
high  bypass  ratio  fan  jets  very  similar  to 
those  that  have  been  used  on  Boeing  757 
aircraft  for  years.  The  C-17  is  the  first 
modem,  fully  integrated,  all  electronic 
cargo  aircraft.  The  design  includes  a  quad- 
redundant  electronic  flight  control  system 
and  fully  automatic  electronic  monitoring 
of  all  systems  to  enable  the  aircraft  to  be 
fully  supported  by  an  aircrew  of  three 


people:  two  pilots  and  one  loadmaster. 

Technologically,  the  heart  of  the  C-17 
is  its  propulsive  lift  system,  which  uses 
engine  exhaust  to  augment  lift  generation. 
By  directing  engine  exhaust  onto  large 
flaps  extended  into  the  exhaust  stream,  the 
C-17  is  capable  of  flying  steep  approaches 
at  remarkably  slow  landing  speeds.  This 
equates  to  the  aircraft’s  ability  to  land  pay- 
loads  as  large  as  160,000  pounds  on  mn- 
ways  as  short  as  3000  feet. 

Once  on  the  ground,  its  ability  to  turn 
in  a  small  radius,  combined  with  its  back¬ 
ing  capability,  allows  the  C-17  to  maneu¬ 
ver  into  and  out  of  tight  parking  spots  as 
well  as  turn  around  on  narrow  mnways. 
This  ground  maneuverability  in  tight  quar¬ 
ters  enables  this  aircraft  to  deliver  more 
cargo  to  small  airfields  with  limited  park¬ 
ing  space  in  a  shorter  time,  increasing 
“throughput.” 

Finally,  throughout  its  design,  the  con¬ 
tractor — McDonnell  Douglas  Transport 
Aircraft  Division  in  Long  Beach,  CA — 
placed  major  emphasis  on  reliability  and 
maintainability,  which  paid  dividends  in 
reduced  maintenance  manpower  and 
spares  requirements.  The  aircraft  was  de¬ 
signed  with  the  maintainer  in  mind,  and 
not  as  an  afterthought.  These  reduced  sup¬ 
port  costs,  combined  with  the  three-per¬ 
son  crew  and  greater  airlift  productivity, 
serve  to  yield  low  life-cycle  costs. 


Col  Davis  is  currently  serving  at  the  U.S.  Special  Operations  Command  Program  Executive 
Office  (USSOCOM  PEO)  for  Fixed  Wing  Aviation,  USSOCOM  Headquarters,  MacDill  Air  Force 
Base,  FL. 

LTC(P)  Phillips  is  currently  serving  as  the  Director  of  Information  Management  &  Assessment 
for  the  Secretary  of  the  Army  for  Research,  Development  and  Acquisition,  Falls  Church,  VA. 

Lt  Col  Vazquez  is  currently  the  Director,  Program  Execution  Office,  Office  of  the  Commander, 
Air  Force  Electronic  Systems  Division,  Hanscom  Air  Force  Base,  MA. 
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Troubled  Times— A  Brief  Review 

I  have  decided  to  put  you  on  the  C-17 
program...say  your  prayers. 

— ^Note  from  the  Air  Force  program 
executive  officer  to  one  of  the 
authors,  June  1993 

Just  how  did  the  C-17  program  get  into 
trouble?  As  one  might  suspect,  there  are 
many  reasons.  Most  notable  of  all  is  that 
the  contractor,  McDonnell  Douglas 
Corporation’s  Transport  Aircraft  Division 
(located  in  Long  Beach,  CA),  throughout 
the  late  1980s  and  early  1990s,  was  con¬ 
sistently  behind  schedule  and  over  bud¬ 
get  on  the  program. 

The  first  C-17  scheduled  to  fly  (known 
as  “T-1”)  became  airborne  nearly  18 
months  after  the  date  indicated  in  the  con¬ 
tract.  Thanks  in  part  to  the  fixed-price  de¬ 
velopment  contract,  and  due  to  the  sting 
of  the  A-12  program  cancellation,  the 
company  was  suffering  financially.  In  fact, 
there  was  considerable  concern  within  the 
Pentagon’s  acquisition  and  contracting 
communities  about  the  company’s  viabil¬ 
ity.  These  tight  purse-strings  constrained 
the  ability  of  corporate  managers  to  invest 
in  much-needed  process  and  equipment 
improvements.  To  compound  these  woes, 
the  company  had  a  tumultuous  experience 
implementing  a  total  quality  management 
system  (TQMS),  wherein  a  large  number 
of  experienced  managers  were  laid  off.  To 
make  matters  worse,  in  hearings  before  the 
House  Sub-Committee  on  Government 
Operations,  the  Air  Force  was  accused  of 
making  improper  progress  payments  to 
McDonnell  Douglas  that,  in  effect,  were 
“bailing  out”  the  struggling  corporation. 
The  Air  Force  was  even  accused  of  ac¬ 


cepting  the  aircraft  with  structurally  weak 
or  “unsafe”  wings. 

After  T-1  finally  flew  on  its  maiden 
voyage  in  September  1991,  it  had  a  series 
of  fuel  leaks,  resulting  in  a  highly  publi¬ 
cized  grounding  (for  about  three  weeks). 
The  aircraft’s  aluminum-lithium  alloy 
flooring  had  many  problems  associated 
with  cracks.  The  failure  to  initially  use  a 
computer-aided  design  and  manufacturing 
(CAD/CAM)  system  to  design  the  aircraft 
caused  both  design  and  production  prob¬ 
lems. 

All  of  this  culminated  in  the  Congres¬ 
sional  decision  to  reduce  the  number  of 
aircraft  purchased  (to  4  from  an  original  6 
in  1993,  and  to  8  from  an  original  12  in 
1994).  These  actions  helped  to  drive  a 
deeper  wedge  between  the  program  office 
and  the  contractor.  McDonnell  Douglas 
found  itself  in  a  position  of  reduced  buys, 
and  therefore  cut  personnel  to  compensate 
for  the  reduced  revenue.  This  action  in¬ 
hibited  its  ability  to  take  advantage  of 
learning  curve  efficiencies,  made  it 
tougher  for  the  company  to  attract  and  re¬ 
tain  quality  subcontractors,  and  resulted 
in  greatly  reduced  morale  and  increased 
chaos.  The  program  was  dangerously 
close  to  cancellation. 


The  Turnaround 


The  C-17  program’s  incredible  turn¬ 
around  truly  began  in  late  1993 — ^but  the 
year  did  not  exactly  begin  well  for  it.  In 
another  well-publicized  maneuver.  Secre¬ 
tary  of  Defense  Les  Aspin  forced  former 
program  director  Maj .  Gen.  Mike  Butchko 
to  retire,  and  punished  two  other  general 
officers  and  a  senior  civilian  over  the 
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“bailout”  controversy.  The  DoD’s  senior 
acquisition  leaders  recognized  the  di¬ 
lemma  the  program  faced.  Relations  be¬ 
tween  the  contractor  and  the  government 
were  strained  to  the  limit.  The  Air  Force 


blamed  McDonnell  Douglas  for  failure  to 
perform  up  to  the  standards  of  the  con¬ 
tract.  McDonnell  Douglas  blamed  the  gov¬ 
ernment  for  “requirements  creep,”  and  for 
expensive  constmctive  changes  to  the  con¬ 
tract.  Thus,  the  contractor  had  staked  a 
series  of  contractual  claims  worth  over  a 
billion  dollars  against  the  government.  The 
program  had  reached  an  impasse. 

Hunting  for  a  way  out  of  the  logjam, 
Under  Secretary  of  Defense  for  Acquisi¬ 
tion  and  Technology  (USD[A&T])  John 
Deutch  commissioned  a  Defense  Science 
Board  task  force  to  study  the  program  and 
to  make  recommendations.  The  leaders  for 


"The  Air  Force 
blamed  McDonnell 
Douglas  for  failure 
lo  perform  up  to  the 
standards  of  the 
contract.  McDonnell 
Douglas  blamed  the 
government  for 
"requirements 
creep,"  and  for 
expensive  construc¬ 
tive  changes  to  the 
contract." 


this  effort  were 
Air  Force  Lt. 
Gen.  Jim  Fain, 
who  was  serv¬ 
ing  as  the  com¬ 
mander  of  the 
Aeronautical 
Systems  Center 
in  Dayton,  OH, 
and  Robert  A. 
Fuhrman,  the 
respected  and 
retired  chief  op¬ 


erating  officer 
of  Lockheed  Corporation.  The  program’s 
landscape  was  littered  with  three  major 
land  mines,  and  it  was  these  three  that  the 
task  force  had  to  negotiate  through  and 
around: 


•  The  fixed-price  contract  did  not  ac¬ 
count  for  the  unknowns  of  a  develop¬ 
ment  program,  and  led  to  incessant 


contractual  and  legal  bickering  over 
who  was  to  pay. 

•  Congressional  changes  laid  in  a  four- 
year  gap  between  when  McDonnell 
Douglas  “won”  the  C-X  competition, 
and  when  development  would  be  fully 
funded.  This  gap  also  saw  legislation 
forcing  the  Air  Force  to  buy  50  C-5Bs 
and  44  KC-lOs. 

•  Last,  and  certainly  not  least,  poor  per¬ 
formance  by  McDonnell  Douglas  was 
apparent  in  all  aspects  of  the  program. 

The  Sehlement 

In  order  to  effect  change,  the  task  force 
knew  that  both  parties  would  have  to  agree 
to  substantive  concessions.  To  make  a  very 
long  story  very  short,  McDonnell  Douglas 
was  persuaded  to  drop  all  its  current  and 
pending  claims  against  the  government, 
and  they  agreed  to  invest  more  than  $100 
million  into  improved  manufacturing  pro¬ 
cesses  and  equipment,  a  modem  manage¬ 
ment  information  system,  CAD/CAM,  an 
ISO-based  advanced  quality  system,  and 
a  host  of  other  small  but  needed  changes. 
As  the  government’s  portion  of  the  settle¬ 
ment,  the  Air  Force  increased  the  contract 
ceiling  price  by  $237  million  (effectively 
paying  that  amount  to  the  contractor),  and 
relaxed  a  number  of  specification  require¬ 
ments  to  reflect  the  change  to  a  post-Cold 
War  world. 

In  the  late  summer  of  1993,  there  was  a 
concerted  and  highly  guarded  effort  to 
develop  a  way  to  wipe  the  slate  clean  for 
both  government  and  contractor.  It  was 
one  of  the  better-kept  secrets  in  the  infa¬ 
mously  leaky  halls  of  the  Pentagon.  Speci¬ 
fications  were  rewritten  to  account  for 
shortfalls  and  to  represent  actual  opera- 


414 


The  Phoenix  Rises 


tional  requirements,*  various  government 
and  contractor  legal  claims  were  added  up, 
and  vigorous  debates  on  the  appropriate 
(money,  consideration,  additional  invest¬ 
ment,  etc.)  relief  ensued.  On  January  6, 
1994,  at  least  five  months  later  than  the 
Office  of  the  Secretary  of  Defense  (OSD) 
and  Air  Force  staffs  had  originally  antici¬ 
pated,  the  settlement  was  approved  and 
signed  by  John  Deutch  and  John 
McDonnell. 

If  there  is  one  truth  about  the  turnaround 
of  this  program  it  is  that  one  can  hardly 
underestimate  the  importance  of  the  settle¬ 
ment.  The  settlement  provided  all  involved 
the  tabula  rasa  needed  to  continue  build¬ 
ing  the  aircraft,  moving  the  program  focus 
back  to  customers,  managers,  and  engi¬ 
neers,  and  away  from  the  lawyers  and  con¬ 
tracting  officials. 

Knowing  the  value  of  a  goodwill  ges¬ 
ture  in  the  never-ending  legislative  branch 
debate,  McDonnell  Douglas  began  to 
make  much-needed  investments  even  be¬ 
fore  the  agreement  was  formally  signed. 
The  new  management  teams  could  move 
forward  as  teammates,  rather  than  as  ad¬ 
versaries.  Furthermore,  the  settlement 
gave  everyone  involved  in  the  program  a 
sense  of  optimism  that  had  been  long 
gone.  Things  were  looking  up!  At  this 
point,  it  was  in  the  labyrinth  of  the  Penta¬ 
gon  where  the  road  to  recovery  began  to 
build  upon  the  settlement’s  optimistic 
momentum. 


Meanwhile,  Back  At 

The  Pentagon _ 

On  November  8,  1993,  the  fifth  meet¬ 
ing  of  Defense  Acquisition  Board  (DAB), 


which  had  begun  in  August  1993,  con¬ 
cluded.  John  Deutch  left  room  3D1019, 
and  called  an  executive  session  in  his  of¬ 
fice.  Shortly  thereafter,  as  the  generals  and 
senior  civilians  scurried  back  to  their  of¬ 
fices,  the  respective  staffs  were  hastily  as¬ 
sembled  to  begin  what  would  become  a 
concentrated  effort  to  turn  the  C-17  pro¬ 
gram  around. 

The  decision  that  rumbled  through  the 
Pentagon  was  hardly  a  surprise  to  those 
close  to  the  program  and  its  turbid  history. 
Rather  than  the  planned  120  aircraft,  DoD 
would  commit  to  buying  no  more  than  40 
C-17’s,  with  subsequent  buys  predicated 
on  improved  C-17  performance,  quality, 
and  a  marked  reduction  in  price.  The  time 


pressures  were 
immense:  the 
acquisition 
community  had 
24  months  to  do 
it  or  buy  a  dif¬ 
ferent  airlift  air¬ 
craft.  At  the 
DAB  meeting. 


"If  there  is  one 
truth  about  the 
turnaround  of  this 
program  it  is  that 
one  can  hardiy 
underestimate  the 
Importance  of  the 
settlement." 


data  presented 

by  the  Institute  for  Defense  Analyses 
(IDA)  showed  that  if  the  Globemaster  III 
did  not  perform  up  to  specifications, 
mixed  buys  of  C-17s  and  Boeing  747-400 
freighters  might  be  a  cost-effective  option 
to  the  previously  planned  120  C-17s. 
Deutch,  who  was  soon  to  become  the 
Deputy  Secretary  of  Defense,  delegated 
the  responsibility  for  turning  this  concept 
into  reality  over  to  Rudy  deLeon,  the  Un¬ 
der  Secretary  of  the  Air  Force.  The  Air 
Force’s  acquisition  community  and  C-17 
program  brain  trust — Deputy  Assistant 
Secretary  Darleen  Druyun,  the  incoming 
Program  Executive  Officer  (PEO)  Brig. 
Gen.  Jim  Childress,  Airlift  Directorate 
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Brig.  Gen.  Jim  Richards,  and  Program  Di¬ 
rector  Brig.  Gen.  Ron  Kadish — had  a  huge 
task  before  them. 

Work  began  immediately  on  three  pri¬ 
orities.  First,  efforts  to  turn  the  C-17  pro¬ 
gram  from  a  disaster  into  a  viable  program 
had  to  be  continued  at  an  ever-heightened 
pace.  Second,  a  competitive  alternative  to 
the  C-17,  primarily  in  the  form  of  a 
slightly  modified  Boeing  747-400 
freighter,  and  revitalized  C-5  (to  become 
known  as  the  C-5D),  had  to  be  ready  to 
be  executed  by  the  scheduled  November 
1995  DAB  meeting — no  small  task  con¬ 
sidering  there  weren’t  even  people  as¬ 
signed  to  these  projects  yet.  Third,  a  pro¬ 
cess  had  to  be  devised  that  pulled  all  the 
constituencies,  personalities,  and  details 
together  for  another  DAB  meeting  not 
later  than  November  1995. 

Most  of  these  issues  fell  squarely  into 
the  lap  of  the  new  Air  Force  program  ex¬ 
ecutive  officer  for  tactical  and  airlift 

(AFPEO/TA), 
then  Brig.  Gen. 
Jim  Childress. 
Having  arrived 
from  the  F-15 
System  Pro¬ 
gram  Director 
(SPD)  position 
at  Warner  Rob¬ 
ins  Air  Force 
Base  in  the  sum¬ 
mer  of  1993, 
Childress  was 
assigned  as 
SAF/AQX,  or  the  Directorate  of  Manage¬ 
ment  Policy  and  Program  Integration.  He 
was  thrust  into  the  PEG  position  when  Lt. 
Gen.  Ed  Franklin  left  to  take  command  of 
Hanscom  Air  Force  Base’s  Electronic  Sys¬ 
tems  Center.  He  and  his  C-17  SPD,  Brig. 


Gen.  Ron  Kadish,  and  the  new  McDonnell 
Douglas  program  manager,  Don 
Kozlowski,  had  the  monumental  task  of 
working  to  make  good  on  the  myriad  of 
demands  and  promises.  Given  the  long- 
lead  time  to  “cut-in”  production  line  im¬ 
provements  in  order  to  see  tangible  results 
within  24  months,  they  were  already  be¬ 
hind  schedule. 

The  Childress  Plah 

Brigadier  General  Childress  immedi¬ 
ately  and  correctly  recognized  that  a  de¬ 
tailed  plan  had  to  be  built,  coordinated, 
and  executed,  and  that  this  plan  would 
require  the  “buy-in”  of  all  of  the  key 
people  in  the  Pentagon.  This  plan,  and  its 
many  evolving  parts,  captured  the  key 
events  and  the  process  by  which  the  Air 
Force  proposed  to  bring  the  salient  parts 
together  by  November  1995.  There  were 
a  few  key  components  of  the  plan. 

Childress  envisioned  continuing  the 
highly  successful  chief  executive  officer 
(CEO)  meetings  started  by  his  predeces¬ 
sor,  Lt.  Gen.  Ed  Franklin.  These  small  and 
confidential  meetings  between  the  Secre¬ 
tary  of  the  Air  Force  and  John  McDonnell 
(and  including  a  small  group  of  the  most 
senior  Air  Force  and  Army  leaders)  kept 
issues  squarely  in  the  limelight  for  imme¬ 
diate  decisions.  They  continued  quarterly 
for  the  next  two  years. 

He  created  and  implemented  what  be¬ 
came  known  as  the  “Milestone  HI  Steer¬ 
ing  Committee.”  This  was  another  quar¬ 
terly  gathering  aimed  at  managing  the  in¬ 
evitable  process  issues  that  were  certain 
to  appear  on  the  way  to  the  DAB.  The 
group  was  chaired  by  Rudy  deLeon,  the 
Under  Secretary  of  the  Air  Force.  Unlike 
the  CEO  meetings,  this  forum  had  wide 
membership,  and  included  OSD  represen- 


"Brlgadier  General 
:  Childress  immedi¬ 
ately  and  correctly 
recognixed  that  a 
detailed  plan  had  to 
be  built,  coordi¬ 
nated,  and  executed; 
and  that  this  plan 
would  require  the 
"buy-in"  of  all  of 
[  the  key  people  in 
:  the  Pentagon." 
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tation.  It  was  an  integrated  process  team 
(IPT)  at  its  best  and  at  the  Pentagon  staff’s 
highest  level. 

In  addition,  given  the  complex  process 
needed  to  force  all  the  disparate  pieces  to 
come  together  by  November  1995,  the 
acquisition  community  could  not  afford 
disagreement  with  the  process  used  to  get 
there.  Accordingly,  General  Childress  pro¬ 
posed  a  major  briefing  to  the  DAB  princi¬ 
pals  a  full  year  ahead  of  time,  in  Novem¬ 
ber  1994.  This  evolved  into  a  full-blown 
DAB  meeting  (affectionately  known  by 
many  as  a  “practice  DAB”)  wherein  the 
plan  to  get  to  the  Milestone  decision  in 
November  1995  was  approved.  This  was 
another  stroke  of  genius.  The  PEG  had 
substantially  lowered  the  risk  that  there 
would  be  disagreement  over  the  approach 
at  the  Milestone  DAB  meeting,  when  it 
would  be  too  late  to  do  much  about  it. 

These  initiatives  were  applauded  and 
supported  up  and  down  the  chain  of  com¬ 
mand.  General  Childress  had  gained  the 
planning  “high  ground”  in  the  Pentagon. 
It  was  now  his  plan,  and  suggestions  to 
change  it  went  to  him — rather  than  the 
PEG  having  to  get  it  issued  from  “on 
high.”  There  were  three  main  “annexes” 
to  the  attack  plan.  Figure  1  shows  a  sim¬ 
plified  process  plan  used  to  integrate  the 
nondevelopmental  airlift  aircraft  (NDAA) 
competition  with  the  C-17  program.  Fig¬ 
ure  2  shows  the  overall  management  plan 
for  managing  the  process  through  1994 
and  1995.  Figure  3  shows  the  detailed  plan 
for  the  last  180  days  before  the  DAB  meet¬ 
ing — the  period  when  pre-DAB  activity 
reaches  a  crescendo. 

Surprise!  The  Cut  to  Four 

Early  in  1994,  and  just  after  the  settle¬ 
ment  was  finalized,  DoD  and  the  Air  Force 


prepared  for  their  annual  Congressional 
testimony.  As  expected.  Air  Force  airlift 
testimony  supported  Deutch’s  decisions 
and  made  the  continued  signs  of  C-17 
technical  progress  prominent.  Nonethe¬ 
less,  the  key  professional  staffer  for  the 
House  Armed  Services  Committee 
(HASC),  Bruce  MacDonald,  was  non¬ 
plused,  to  say  the  least.  A  strong  advocate 
of  using  commercial  airlifters  like  the 
Boeing  747  in  the  years  preceding  the 
Deutch-led  DAB  session,  in  late  April 
MacDonald 

"...given  the  com¬ 
plex  process  needcid 
to  force  all  the 
disparate  pieces  to 
come  together  by 
ilovember  1995,  the 
dcquisitieii  commu¬ 
nity  could  not  alfprti 
disagreement  vrith 
the  process  used  to  i 
get  there." 


convinced  the 
HASC  mem¬ 
bers  to  recom¬ 
mend  a  cut  from 
the  plan  of  six 
C-17s  for  the 
sixth  produc¬ 
tion  lot,  down  to 
four.  The  legis¬ 
lation  would 
then  use  the 


“savings”  to  be- :  : 

gin  buying  commercial  airlifters. 

This  recommended  cut  would  be  disas¬ 
trous  to  DoD  plans.  It  would  not  allow  the 
Deutch  plan  to  unfold,  it  would  not  give 
McDonnell  Douglas  time  to  make  im¬ 
provements,  and  it  would  not  provide  any 
major  near-term  benefits  to  U.S.  strategic 
mobility  capabilities.  Just  as  McDonnell 
Douglas  was  making  progress,  the  reduc¬ 
tion  would  increase  the  price  of  the  air¬ 
plane,  probably  cause  layoffs,  and  wreck 
the  program.  Something  had  to  be  done — 
and  quickly. 

Rudy  deLeon  called  the  Air  Force  brain 
trust  together  that  Friday  evening  to  de¬ 
velop  the  plan  that  would  counter  this  leg¬ 
islative  threat.  It  called  for  a  full-court 
press  to  save  the  C-17.  Senior  leaders 
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Figure  1.  Decision  Process 


throughout  the  Air  Force  and  DoD  would 
be  mobilized  to  meet  with,  write  to,  or  call 
key  members  of  Congress.  A  bipartisan  al¬ 
liance  of  Democrats  and  Republicans 
formed  the  nucleus  of  the  effort.  A  “white 
paper”  making  the  case  for  restoring  the 
cuts  and  allowing  the  Deutch  plan  to  un¬ 
fold  was  needed.  And  it  would  have  to  be 
built  over  the  weekend  by  a  small  team  of 
Pentagon  action  officers,  division  chiefs, 
and  OSD  lawyers.  The  White  Paper  made 
a  convincing  case  of  all  the  reasons  the 
cut  would  be  counterproductive  and  was 
a  remarkable  success.  As  a  result,  in  an 
unprecedented  move,  the  cuts  recom¬ 
mended  by  the  HASC  were  overturned  in 
a  vote  on  the  floor  of  the  House  of  Repre¬ 
sentatives.  The  C-17  was  saved,  at  least 
temporarily. 


Jointness  and  the  Team  Effort  to  Save 
THE  C-17 

A  prime  lesson  for  those  in  the  Penta¬ 
gon  was  that  jointness  is  goodness.  With¬ 
out  the  vigorous,  vocal,  and  continual  sup¬ 
port  of  the  U.S.  Army,  the  C-17  would 
likely  be  a  relic  of  the  past,  rather  than  the 
core  airlifter  of  the  future.  In  the  Army’s 
Concepts,  Doctrine  &  Force  Policy  Divi¬ 
sion  (DAMO/FDQ),  then-Brig.  Gen.  John 
Riggs  and  his  action  officer,  then-Maj. 
John  Bums,  were  assigned  to  stay  actively 
engaged  in  the  program.  Lt.  Cmdr.  Dan 
Page’s  role  as  the  Army  liaison  to  the  pro¬ 
gram  office  in  Dayton  took  on  heightened 
importance.  The  Air  Force  acquisition 
community  welcomed  this  participation 
and  did  its  best  to  keep  the  Army  informed, 
involved,  and  working  issues  that  needed 
Army  help.  For  instance,  at  one  time  the 
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Figure  2.  Timeline  Overview  for  €-17,  SAFMA,  NDAA 
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Figure  3.  Integrated  Schedule 
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Joint  Staff  alleged  that  there  were  no  plans 
for  strategic  brigade  airdrop.  John  Bums’ 
research  found  no  less  than  6  historical  ex¬ 
amples  and  10  active  plans  that  program 
proponents  used  to  counter-punch  our  way 
to  advantage.  When  the  Army’s  plans  for 
Direct  Delivery  proved  to  be  more  a  con¬ 
cept  than  an  operational  plan,  Riggs  and 
Burns  helped  motivate  several  tactical 
analyses,  that  rightly  accounted  for  the  C- 
17’s  ability  to  deliver  outsize  equipment 
to  tactical  assembly  areas,  and  that  would 
greatly  help  prove  the  C-17’s  worth.  The 
cooperative  approach  would  work  out  tre¬ 
mendously. 

The  Army— An  Invaluable  Partner 

The  U.S.  Army  was  considered  by  the 
Air  Force  to  be  ultimate  user  of  the  air¬ 
craft;  and  therefore  a  highly  valued  cus¬ 
tomer.  The  Pentagon,  company,  and  the 
system  program  office  (SPO)  worked  to¬ 
gether  to  ensure  that  the  Army  was  a  full 
member  of  the  team  as  the  program  turned 
the  comer.  An  example  of  the  high  spirit 
of  jointness  exhibited  under  General 
Kadish’s  leadership  was  the  joint  effort  to 
approve  the  C-17  for  airdrop  missions. 
After  many  fits  and  starts,  new  procedures 
and  equipment  were  used  to  better  meet 
the  Army’s  needs.  In  a  brigade  airdrop 
“slice”  demonstration  in  the  spring  of 
1995,  six  C-17’s  successfully  dropped 
more  than  200  Army  paratroopers  and  a 
large  compliment  of  heavy  equipment 
with  absolute  precision.  This  demonstra¬ 
tion  took  place  in  front  of  a  host  of  DoD 
distinguished  visitors,  including  the  DoD 
director  of  operational  test  and  evaluation. 

The  strategic  importance  of  the  C-17 
was  quickly  demonstrated  in  real  life  by 
the  superb  support  the  aircraft  provided 
Operation  Joint  Endeavor.  Having  just 


been  designated  as  operationally  capable, 
the  aircraft  was  called  upon  to  provide 
both  strategic  and  operational  lift  for  the 
NATO  Implementation  Force  (IFOR) 
move  into  Bosnia.  The  aircraft  demon¬ 
strated  its  superb  mission  flexibility  in 
support  of  the  IFOR  Savo  River  crossing. 
When  flooding 
caused  a  need 

for  additional  "A  prime  lessen  for 

bridging  sec-  *h«*se  Penfo- 

tions,  innova-  f"*"**!*"*  , 

,  ioiitlness  Is  good- 

tive  people  dis-  « 

covered  these 
“outsize”  sec¬ 
tions  could  be  loaded  onto  flatbed  trailers 
and  driven  right  on  and  off  the  aircraft. 
The  sections  were  delivered  by  C-17  and 
driven  to  the  river.  The  time  savings  for 
this  outstanding  example  of  direct  deliv¬ 
ery  was  measured  in  hours  rather  than 
days.  Further,  within  the  first  six  months, 
the  C-17  had  flown  almost  half  the  ton¬ 
nage  in  only  one  quarter  of  the  missions. 
This  equates  to  508  missions;  4108  pas¬ 
sengers  (27%  of  all  passengers);  and 
12,610  tons  of  cargo  (48%  of  all  cargo  car¬ 
ried  into  the  region).  The  aircraft’s  per¬ 
formance  has  been,  and  continues  to  be, 
truly  exceptional  and  critical  to  the  suc¬ 
cessful  sustainment  of  Operation  Joint 
Endeavor.  The  C-17  has  proven  its  worth 
in  its  very  first  test. 


The  "Should  Cost" 

We  mentioned  a  key  objective  was  to 
lower  the  cost  of  buying  C-17s.  A  direct 
impact  of  the  decision  to  temporarily  cap 
the  program  at  40  was  to  greatly  inflate 
the  cost  of  each  C-17.  During  the  Con¬ 
gressional  reporting  cycle  in  December  of 
1993,  the  total  program  cost  (research, 
development,  production,  and  mainte- 
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nance)  divided  by  40  worked  out  to  well 
over  $500  million  per  aircraft.  The  acqui¬ 
sition  community  could  hardly  endure 
these  headlines  and  expect  a  41  st  aircraft. 
At  the  suggestion  of  DoD  Inspector  Gen¬ 
eral  Derek  Vander  Schaaf,  and  with  the 
concurrence  of  deLeon,  the  Air  Force  was 
asked  to  perform  a  top-to-bottom  cost 

“scrub”  aimed 
"The  siralegic  at  reducing  pro- 

importance  of  the  gram  cost.  After 

C-17  was  quickly  some  initial 

demonstrated  in  pause  (several 

real  life  by  the  of  these  studies 

superb  support  the  had  occurred 

aircraft  provided."  ^j^h  unle  to 

show),  a  new 
and  high-powered  approach  took  shape. 
Lt.  Gen.  Dick  Scofield,  General  Fain’s  re¬ 
placement  at  Wright-Patterson  Air  Force 
Base,  OH,  would  lead  an  effort  aimed  not 
at  identifying  “potential”  savings  (as  was 
common  in  past  attempts),  but  at 
implementable  savings. 

This  minor  shift  was  tremendously  im¬ 
portant.  The  focus  was  now  on  realistic 
and  realizable  savings,  and  under  Darleen 
Druyun’s  leadership  at  the  Pentagon,  the 
group  worked  miracles.  Using  the  invest¬ 
ment  monies  from  the  settlement  and  the 
corporate  coffers,  the  team  searched  for 
the  high-payback  items  with  great  success. 
Of  great  import,  and  precisely  because  the 
aim  was  on  implementation,  the  contrac¬ 
tual  vehicles  performed  in  parallel  so  that 
time  (and  the  associated  opportunity  for 
payback)  would  not  be  wasted.  In  addi¬ 
tion,  all  the  stakeholders — ^the  auditors,  the 
contractors,  and  the  government — agreed 
to  a  single  cost  model.  By  the  summer  of 
1995,  the  team  identified  cost  savings  that 
brought  down  the  cost  of  the  C-17  to  little 
more  than  that  of  a  Boeing  747-400.  The 


C-17  now  cost  $172  million  in  “flyaway 
cost”  per  aircraft  in  constant  1995  dollars. 
This  was  a  number  many  Pentagon  bureau¬ 
crats  thought  impossible  to  reach,  and  this 
achievement  gave  rise  to  more  optimism. 

Occurring  almost  simultaneously  with 
events  in  the  Pentagon,  and  shortly  after 
the  settlement,  was  another  watershed 
event  vital  to  the  turnaround.  Senior  lead¬ 
ership  at  both  the  SPO  and  McDonnell 
Douglas  changed.  Brig.  Gen.  Ron  Kadish 
transitioned  from  his  position  as  F-1 6  pro¬ 
gram  director  to  the  directorship  of  the  C- 
17  program.  McDonnell  Douglas  put  Don 
Kozlowski,  a  McAir  veteran  program 
manager  from  St.  Louis,  MO,  in  charge 
in  Long  Beach.  These  two  leaders  shared 
common  goals;  turn  the  program  around, 
make  it  successful,  and  do  it  post  haste. 


The  Program  Office-Contract 
OR  Partnership 


Perpetual  optimism  is  a  force  multi¬ 
plier. 

— Gen.  Colin  Powell 

The  first  steps  the  new  leadership  took 
involved  personnel  and  organizational 
structure.  They  jointly  formed  “mirror 
image”  integrated  product  teams  (IPTs)  to 
help  them  to  manage  the  program  as  part¬ 
ners.  These  IPTs  were  consciously  orga¬ 
nized  around  C-17  product-related  areas, 
and  in  the  long  run  proved  massively  suc¬ 
cessful  for  program  execution.  General 
Kadish  and  Kozlowski  empowered  these 
IPTs.  Each  team  received  talent  from  all 
of  the  key  functional  areas  of  expertise, 
and  the  team  leaders  had  the  trust  and  con¬ 
fidence  of  the  program  leadership  to  the 
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extent  that  they  made  decisions  for  pro¬ 
gram  execution.  The  initiation  of  IPTs  fa¬ 
cilitated  joint  decision  making,  and  pro¬ 
mulgated  full  and  open  communication. 
They  allowed  program  managers  on  both 
sides  to  focus  on  program  events,  as  they 
jointly  worked  the  issues.  The  government 
and  the  contractor  jointly  developed  an  in¬ 
tegrated  master  plan  that  included  lower 
level  integrated  schedules. 

Integrated  program  management  also 
resulted  in  the  following:  joint  configura¬ 
tion  management  control;  quarterly  joint 
executive  program  management  reviews; 
and  a  program  reporting  system  that  con¬ 
solidates  issues  and  tracks  actions.  All  of 
this  fostered  the  feeling  that  both  the  con¬ 
tractor  and  the  SPO  shared  a  common  des¬ 
tiny.  Perhaps  the  best  way  to  describe  what 
integrated  product  development  brought 
to  this  program  is  to  contrast  the  old  way 
of  doing  C-17  business  with  the  way 
things  worked  once  IPTs  formed.  The  old 
way  is  best  characterized  this  way:  differ¬ 
ent  organizations,  functional  process  fo¬ 
cus,  us  versus  them,  slow  and  guarded 
communications,  plans  integrated  at  pro¬ 
gram  level,  multiple  schedules,  and  func¬ 
tional  budgets.  The  new  way  of  doing 
business  included:  aligned  organization, 
product  focus,  we,  rapid  and  open  com¬ 
munications,  team  planning,  an  integrated 
master  schedule,  and  team  budgets. 

Communication  was  another  key  to 
success.  Any  problems,  potential  prob¬ 
lems,  or  obstacles  in  the  way  of  progress 
were  dealt  with  openly.  General  Radish’s 
motto  “bad  news  doesn’t  get  better  with 
age”  was  clear  guidance  to  communicate 
openly  and  honestly,  without  fear  of  retri¬ 
bution. 

Kozlowski  brought  a  renewed  sense  of 
purpose  to  the  McDonnell  Douglas  C-17 


team.  He  implemented  major  organiza¬ 
tional  changes  and  installed  proven  per¬ 
formers  in  key  team  positions.  Most  im¬ 
portant,  he  essentially  reinvented  senior 
management’s  relationship  with  the  em¬ 
ployees.  Among  his  key  leadership 
achievements  were:  a  fresh  focus  on  team 
solutions  and 
accountability, 

75  percent  re¬ 
duction  in  lost 
work  days  due 
to  accidents  on 
the  production 
floor,  employee 
involvement 
and  gain  shar¬ 
ing,  a  renewed 
relationship  by  objectives  with  the  UAW 
union,  employee  recognition  programs,  in¬ 
creased  emphasis  on  skills  training,  and 
an  80  percent  reduction  in  grievances. 

General  Kadish  and  Kozlowski  set  up 
three  definitive  goals  at  the  outset,  with  a 
relatively  near-term  focus.  These  goals 
were:  to  achieve  initial  operating  capabil¬ 
ity  (IOC)  in  January  1995,  to  successfully 
complete  the  reliability,  maintainability, 
and  availability  evaluation  (RM&AE)  in 
July  1995,  and  to  successfully  complete 
the  DAB  review  in  November  1995.  To 
ensure  consistency,  each  of  these  three 
goals  had  joint  integrated  master  plans  and 
integrated  master  schedules  associated 
with  them.  Each  IPT  aggressively  man¬ 
aged  its  portion  of  all  three  goals. 

The  first  goal,  IOC,  involved  deliver¬ 
ing  the  12th  operational  C-17  to  the  437th 
Air  Wing  at  Charleston  Air  Force  Base, 
SC.  All  12  aircraft  had  to  be  fully  support¬ 
able,  and  we  needed  48  fully  qualified  air¬ 
crews  for  IOC  to  be  declared.  The  plan¬ 
ning  and  scheduling  “drills”  just  discussed 


'‘These  two  leaders 
(Brig.  Gen.  Ron 
Kadish  and  Don 
Kozlowski)  shared 
common  goals:  turn 
the  program  around/ 
make  it  successful, 
and  do  It  post 
haste." 
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Table  1. 

RM&AE  Results  for  the  C 

-17 

Parameter 

Actual 

Req. 

What’s 

Percent 

Percent 

Good 

On-time  departure  reliability 

99.20 

n/a 

n/a 

Mission  completion  success  probability  (MCSP) 

97.50 

86.00 

Higher 

Mean  time  between  maintenance  (inherent)  MTBM(l) 

3.94 

1.31 

Higher 

Mean  time  between  maintenance  [corrective]  MTBM(C) 

1.81 

0.63 

Higher 

Mean  time  between  removal  (MTBR) 

8.47 

2.26 

Higher 

Maintenance  man  hours  per  flight  hour  (MMH/FH) 

3.45 

27.7 

Lower 

Mean  man  hours  to  repair  (MMTR) 

2.50 

8,16 

Lower 

Mission  capable  (MC)  rate 

90.70 

80.80 

Higher 

Fully  mission  capable  (FMC)  rate 

85.10 

73.00 

Higher 

Note:  Requirements  and  goals  above  are  based  on  growth  curves  leading  to  mature 
values. 

1.  RM&AE  numbers  based  on  15,000  hr  (est). 

2.  Mature  numbers  based  on  1 00,000  hr. 

had  uncovered  major  disconnects  in  time 
for  us  to  fix  them.  The  Air  Mobility  Com¬ 
mand  commander  declared  IOC  on  Janu¬ 
ary  17, 1995. 

The  second  goal,  successful  completion 
of  the  RM&AE,  involved  flying  all  12  of 
the  437th’s  C-17s  at  an  up-tempo  pace  for 
30  consecutive  days.  The  plan  called  for 
C-17  operations  at  small  austere  airfields, 
transatlantic  long-haul  missions,  and  con¬ 
stant  “quick  turnarounds.”  The  evaluation 
called  for  collecting  extensive  sortie  gen¬ 
eration  rate  data,  mean  time  between  fail¬ 
ure  data,  mean  time  to  repair  data,  and  on- 
time  takeoff  data.  In  addition,  mission 
completion  success  rates  were  monitored 
closely.  This  exercise  took  place  during 
July  and  August  1995,  and  the  C-17  per¬ 


formed  magnificently.  Key  results  are 
shown  in  Table  1 . 

The  third  and  final  goal,  successful 
completion  of  the  combined  C-17  and 
NDAA  DAB  session,  was  reached  early 
in  November  1995.  Certainly  the  success¬ 
ful  achievement  of  the  first  two  goals  con¬ 
tributed  mightily  to  this  outcome.  It  will 
go  down  in  acquisition  history  as  one  of 
the  smoothest  and  least  controversial  DAB 
meetings  ever.  The  ultimate  decision,  an¬ 
nounced  by  Deputy  Secretary  of  Defense 
John  P.  White,  was  for  a  total  buy  of  120 
C-17s,  and  a  discontinuance  of  the  NDAA 
program. 

Having  cleared  the  initial  three  program 
goals  with  flying  colors.  General  Kadish 
and  Kozlowski  refocused  the  C-17  team 
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on  three  new  goals:  deliver  and  sustain  a 
quality  C-17  fleet,  improve  the  weapon 
system’s  capability  and  support,  and  lower 
the  life  cycle  cost.  They  developed  an  in¬ 
novative  way  to  separate  C-17  contracts 
to  provide  better  visibility  into  cost  per¬ 
formance.  The  result  was  a  scheme  to  or¬ 
chestrate  three  discernible  contracts:  the 
production  contract  to  correctly  isolate 
flyaway  cost  to  the  production  contract; 
the  performance  enhancement  and  prod¬ 
uct  improvement  (PE/PI)  contract  to  di¬ 
rectly  manage  the  enhancement  process; 
and  the  field  support  contract  to  directly 
manage  the  field  support  expense.  Clearly, 
there  was  a  need  to  reduce  the  cost  of  the 
C-17.  Therefore,  the  SPO  and  McDonnell 
Douglas  embarked  on  a  journey  to  make 
the  aircraft  more  affordable.  This  effort 
would  soon  intensify  with  a  major  effort 
in  1994  and  1995  to  enhance  affordability. 

There  were  two  basic  ways  to  cut  costs: 
through  greater  efficiency  or  through  de¬ 
sign  changes.  To  achieve  greater  effi¬ 
ciency,  the  focus  was  on  lowering  indi¬ 
rect  costs,  lean  aircraft  initiative  concepts, 
high-speed  machining,  outsourcing,  low- 
cost  suppliers,  production  span  time  re¬ 
ductions,  and  modern  assembly  tech¬ 
niques.  On  the  design  change  side  of  the 
equation,  the  focus  areas  were  design  for 
manufacturing  and  assembly,  avionics 
technology  upgrades,  and  commercially 
available,  highly  reliable  microcircuits. 
The  company  began  to  focus  on  these 
ideas,  and  it  began  to  pay  off  almost  im¬ 
mediately.  The  ultimate  results  of  all  of 
these  cost  reduction  efforts  were  impres¬ 
sive  and  irrefutable.  McDonnell  Douglas’ 
investment  into  the  program,  combined 
with  nearly  $4  billion  in  cost  reduction  ini¬ 
tiatives,  resulted  in  lowering  the  flyaway 
cost  of  a  C-17  from  approximately  $275 


million  to  $172  million  (CY$95). 

In  addition.  General  Kadish  initiated  a 
unique  award  fee  concept.  His  award  fee 
plan  focused  on  program  benefits,  with  an 
eye  toward  initiatives  to  further  reduce  the 
cost  of  the  C-17,  and  toward  encourag¬ 
ing  management  responsiveness  and  pro¬ 
gram  integration.  This  served  as  a  highly 
effective  motivator,  as  significant  progress 
was  made  in  all  areas. 


Building  Success  in  Long  Beach 

A  partnership  is  fragile — it  must  not 
be  taken  for  granted! 

— Col.  Gene  Kluter 
Commander,  DCMC 
McDonnell  Douglas,  1995 

The  Defense  Contract  Management 
Command  (DCMC)  at  McDonnell  Dou¬ 
glas  in  Long  Beach  played  a  major  role  in 
the  C-17’s  turnaround.  The  Defense  Con¬ 
tract  Management  Command  (formerly 
known  as  The  Defense  Plant  Representa¬ 
tive  Office,  or  DPRO)  provides  contract 
administration  services  support  for  the 
C-17  SPO  by  ensuring  that  McDonnell 
Douglas  complies  with  contractual  re¬ 
quirements.  The  SPO  is  the  primary 
DCMC  customer.  The  DCMC  maintained 
active  involvement  with  every  aspect  of 
contractor  operations,  providing  a  variety 
of  services  including  pricing  and  negotia¬ 
tion,  technical  support,  engineering  and 
production  surveillance,  property  manage¬ 
ment,  quality  assurance  and  flight  accep¬ 
tance  of  aircraft. 

Prior  to  1993  an  adversarial  relation¬ 
ship  existed  between  DCMC  Long  Beach 
and  McDonnell  Douglas.  As  previously 
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mentioned,  McDonnell  Douglas  was  be¬ 
hind  schedule  while  contract  costs  con¬ 
tinued  to  escalate.  This  relationship  re¬ 
sulted  in  significant  distrust  between  gov¬ 
ernment  and  contractor  personnel,  each 
blaming  the  other  for  failure  to  meet  con¬ 
tractual  requirements. 

In  August  1992,  Air  Force  Col.  Gene 
Kluter  reported 
as  the  com¬ 
mander,  DCMC 
McDonnell 
Douglas,  Long 
Beach.  The  as¬ 
signments  of 
Brigadier  Gen¬ 
eral  Kadish, 
Kozlowski,  and 
Colonel  Kluter 
completed  the 
tripartite  leader¬ 
ship  (SPO,  McDonnell  Douglas,  and 
DCMC)  that  was  essential  to  establishing 
a  path  toward  success  for  the  C-17  pro¬ 
gram.  Colonel  Kluter  quickly  established 
a  positive,  effective  relationship  with 
Kozlowski,  which  fostered  a  new  era  of 
partnership  built  upon  trust.  Furthermore, 
Kluter  made  a  commitment  to  Kadish  that 
DCMC  would  provide  world  class  sup¬ 
port  for  the  C-17  Program.  This  partner¬ 
ship,  built  upon  tmst,  cooperation,  and  a  firm 
commitment  to  program  excellence,  then  be¬ 
gan  its  march  toward  reversing  the  disas¬ 
ters  of  the  C-17  program. 


"One  of  the  mesi 
challenging  and  far 
reaching  DCMC 
Initiatives  involved 
a  transition  from 
functionally  ori> 
ented  government 
oversight  to  prod* 
uct-  and  process- 
focused  oversight." 


DCMC  Cultural  Change 

One  of  the  most  challenging  and  far- 
reaching  DCMC  initiatives  involved  a 
transition  from  functionally  oriented  gov¬ 
ernment  oversight  to  product-  and  process- 
focused  oversight.  In  1994,  DCMC  began 


to  realign  its  functionally  oriented  divi¬ 
sions  (engineering,  contracts,  and  quality) 
into  product-  and  process-focused  teams. 
Implementation  of  this  approach  to  con¬ 
tract  administration  reflected  a  significant 
cultural  change  for  the  DCMC  workforce. 
The  previous  functional  structure  resulted 
in  stove-piped  organizations  that  inhibited 
open  communication  and  cooperation.  It 
promoted  an  adversarial  relationship  with 
McDonnell  Douglas  through  application 
of  an  inspection  and  detection  approach 
to  determining  nonconformances  that 
were  often  subjective  in  nature.  The  func¬ 
tional  approach  did  not  facilitate  determi¬ 
nation  of  the  root  cause  of  a  nonconfor¬ 
mance;  and  most  often  resulted  in  tempo¬ 
rary  improvement  and  isolated  solutions. 

Conversely,  the  product-  and  process- 
focused  teams  created  an  efficient,  coop¬ 
erative  approach  to  contract  administra¬ 
tion  that  focused  on  prevention  of 
nonconformances  and  the  design  of  qual¬ 
ity  into  the  product.  The  results  were  ob¬ 
jective,  continuous  product  improvements 
and  systematic  solutions  to  noncon¬ 
formances.  Furthermore,  this  approach 
fostered  a  synergy  among  DCMC  team 
members  (in  engineering,  contracts,  and 
quality  assurance),  who  shared  their  pro¬ 
fessional  knowledge  and  skills. 

Process-based  management  proved  to 
be  a  critical  component  for  eliminating 
production  bottlenecks,  as  well  as  reduc¬ 
ing  costs  and  cycle  time. 

— Randy  Mizer,  Vice  President 
for  Program  Integration 
McDonnell  Douglas 
Transport  Aircraft,  1997 
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Process-Based  Management 

Probably  the  most  significant  enhance¬ 
ments  to  C-17  manufacturing  process 
improvement,  production  efficiency,  and 
cost  reductions  resulted  from  McDonnell 
Douglas’  implementation  of  process- 
based  management  (PBM).  PBM  is  a  pro¬ 
prietary  “management  approach  that  de¬ 
fines  an  organization  as  a  collection  of  pro¬ 
cesses  and  that  focuses  on  customer  satis¬ 
faction  and  waste  reduction  by  defining, 
measuring,  stabilizing,  and  improving  pro¬ 
cesses.’’^  It  is  a  formal,  seven-step  process 
that  results  in  disciplined  systems  and  pro¬ 
cesses.  It  closely  resembles  the  DCMC’s 
Process  Oriented  Contract  Administrative 
Services  (PROCAS),  a  program  designed 
to  improve  customer  satisfaction,  reduce 
contract  costs,  and  reduce  the  cost  of  gov¬ 
ernment  oversight.  Process-based  man¬ 
agement  forms  one  major  cornerstone  for 
total  quality  management  (TQM)  at 
McDonnell  Douglas.  It  is  a  proactive  way 
to  manage  a  process,  prevent  process 
nonconformances,  and  anticipate  and 
implement  process  improvements. 

McDonnell  Douglas  implemented 
PBM  in  full  partnership  with  the  DCMC 
and  SPO,  consummated  by  the  signing  of 
a  formal  teaming  agreement.  The  Defense 
Contract  Audit  Agency  (DCAA)  was  an 
active  PBM  participant  as  well. 
McDonnell  Douglas  and  DCMC  identi¬ 
fied  critical  processes  and  designated 
“process  owners”  (MDC  personnel)  and 
“process  specialists”  (DCMC  personnel). 
Process  owners  and  specialists  were  em¬ 
powered  to  manage  the  process  and  es¬ 
tablish  metrics  (e.g.,  defects,  timeliness, 
efficiency,  and  cycle  time)  to  provide  a 
balanced  view  of  process  health. 
McDonnell  Douglas  and  government  per¬ 


"One  of  the  most 
challenging  and  far- 
reaching  DCMC 
iniliafiyes  inyelveci  a 
transition  from 
functierially  oriented 
goyernment  over¬ 
sight  to  product-  and 
process-focused 
oversight." 


sonnel  shared  the  metrics’  results  and  pro¬ 
cess  health  reports. 

The  successful  results  achieved  from 
PBM  implemen¬ 
tation  had  an  ex¬ 
tremely  positive 
impact  on  pro¬ 
gram  execution. 

For  instance,  de¬ 
fects  were  re¬ 
duced  by  92  per¬ 
cent  from  P-16 
(production  air¬ 
craft)  to  P-22, 
while  mandatory 
government  in¬ 
spection  hours  were  reduced  approxi¬ 
mately  70  percent.  Ramp  span  time  was 
reduced  by  61  days  (46  percent)  from  P-7 
to  P-22.  Timely  execution  of  “root  cause 
analysis”  and  resultant  process  improve¬ 
ments  directly  resulted  in  a  59  percent  re¬ 
duction  of  scrap,  rework,  and  repair.  Pro¬ 
cess  improvements  resulted  in  the  elimi¬ 
nation  of  fuel  leaks  on  production  aircraft 
that  saved  $660,000  per  aircraft.  Produc¬ 
tion  span  time  improved  from  505  days 
for  P-9  to  373  days  for  P-23,  a  26  per¬ 
cent  reduction. 

Considering  current  trends,  McDonnell 
Douglas  expects  to  achieve  another  48 
percent  reduction  in  production  span  time 
for  aircraft  P-40,  scheduled  for  delivery 
in  June  1998.  Furthermore,  based  upon  the 
government’s  confidence  in  PBM,  DCMC 
reduced  mandatory  government  inspec¬ 
tion  hours  by  73  percent  (which  equates 
to  16  DCMC  personnel),  and  a  500  hour- 
per-month  reduction  in  Material  Review 
Board  hours.  Greater  reliance  on  PBM  will 
lead  to  great  contractor  self-governance, 
which  translates  directly  into  cost  avoid- 
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ance  to  the  taxpayer  (from  oversight  to 
insight). 

Process  variability  reduction  (PVR) 
achieved  tremendous  success  due  to  the 
implementation  of  PBM,  coupled  with  in¬ 
vestments  in  production  tooling  resulting 
from  the  settlement  agreement. 
McDonnell  Douglas  implemented  a  total 
of  48  process  variability  reduction  projects 
and  38  settlement-induced  projects  that  re¬ 
sulted  in  significant  cost  savings.  For  ex¬ 
ample,  the  main  landing  gear  pod  was  re¬ 
designed  for  easier  manufacturing  and  as¬ 
sembly.  The  number  of  detail  parts  and 
fasteners  were  reduced  from  1,792  to  37, 
resulting  in  8,400  installation  hours  saved 
and  $103  million  of  cost  savings  for  the 
remaining  aircraft. 

Furthermore,  more  efficient  and  effec¬ 
tive  production  tooling  was  installed  to 
reduce  production  bottlenecks.  An  auto¬ 


mated  rivet  gauging  tool  referred  to  as 
“Genesis”  was  installed,  which  signifi¬ 
cantly  reduced  variability  and  rework 
costs.  State-of-the-art  fuselage  alignment 
tools  were  also  installed.  New  informa¬ 
tion  systems  that  realigned  daily  work 
schedules  to  maximize  production  effi¬ 
ciency  were  employed.  What’s  the  bottom 
line,  you  ask?  Effective  implementation 
of  process-based  management  and  process 
variability  reduction  directly  resulted  in  a 
better  product,  faster  delivery  at  reduced 
costs,  and  much  greater  customer  satisfac¬ 
tion. 

Streamlining  Military 

SPECiriCATIONS  AND  STANDARDS 

Few  would  argue  with  the  premise  that 
military  specifications  and  standards  add 
significant  costs  to  government  programs. 
In  some  cases  these  contractual  require- 


GOD  PUT  ME  ON  THIS  EARTH 
TO  ACCOMPLISH  A 
CERTAIN  NUMBER  OF  THINGS 
ON  THEC-17. 

RIGHT  NOW  I  AM  SO  FAR 
BEHIND,  I  WILL  NEVER  DIE! 
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ments  do  add  value  and  are  necessary  to 
ensure  that  the  product  meets  government 
needs.  However,  in  many  cases  they  do 
not  add  value,  a  trend  recognized  by  lead¬ 
ership  within  the  DoD.  On  June  29, 1994, 
Secretary  of  Defense  William  J.  Perry  is¬ 
sued  a  memorandum  on  specifications  and 
standards.  The  memorandum  “directed  the 
use  of  performance  specifications  to  the 
maximum  extent  practicable,  and  the  de¬ 
velopment  of  a  streamlined  procurement 
process  to  modify  existing  contracts  to  en¬ 
courage  contractors  to  propose  nongov¬ 
ernment  specifications  and  industry-wide 
practices  that  meet  the  intent  of  military 
specifications  and  standards  which  impose 
government-unique  management  and 
manufacturing  requirements.” 

Considering  DoD  guidance,  McDonnell 
Douglas  and  DCMC  performed  a  thor¬ 
ough  review  of  contractual  military  speci¬ 
fications  and  standards.  The  mission  was 
to  “challenge  the  requirement”  and  retain 
essential  performance  requirements  or  tai¬ 
lor  them  to  the  C-17  program.  During  full- 
scale  development  of  the  C-17  aircraft, 
there  were  243  contractual  military  speci¬ 
fications  and  standards.  During  Lot  VII 
production,  these  were  reduced  to  30.  The 
review  further  resulted  in  the  current  re¬ 
quirement  of  5  military  specifications  and 
standards — a  significant  reduction.  A  few 
of  the  deleted  specifications  and  standards 
are  Mil-Std-1567A  (work  measurement), 
Mil-Std-965  (parts  control  program),  Mil- 
Std-980C  (foreign  object  debris  preven¬ 
tion),  Mil-Std-483  (configuration  manage¬ 
ment),  and  Mil-Q-9858A  (quality  system). 
These  requirements  were  replaced  by 
commercial  practices  employed  by 
McDonnell  Douglas,  and  thus  the  cost 
associated  with  maintaining  two  sys¬ 


tems — one  for  the  government  and  one  for 
the  company — was  reduced. 

The  deletion  of  Mil-Q-9858A  occurred 
after  McDonnell  Douglas’  successful 
implementation  of  an  ISO  9000  compli¬ 
ant  advanced  quality  system  (AQS).  Ob¬ 
taining  ISO  9000  compliance  was  not  an 
easy  task  by  any  means.  McDonnell  Dou¬ 
glas,  in  partnership  with  DCMC,  estab¬ 
lished  a  detailed 
implementation 
plan  that  in¬ 
cluded  support 
of  external  con¬ 
sultants  well 
versed  in  ISO 
9000.  Company 
and  DCMC  per¬ 
sonnel  under¬ 
went  a  rigorous 
training  pro¬ 
gram,  and  nu¬ 
merous  assessments  were  performed.  In 
October  1995,  DCMC  issued  a  “Statement 
of  the  Qualification.”  The  AQS  resulted 
in  improved  process  metrics,  reduced 
cycle  time  to  implement  corrective  action, 
increased  focus  on  designing  and  build¬ 
ing  in  quality,  and  continuous  reduced  pro¬ 
cess  variability.  Most  important,  the  AQS 
is  compatible  with  commercial  quality 
systems;  it  thus  reduces  costs  to  the  gov¬ 
ernment  by  avoiding  duplicate  systems.  In 
the  June  1996  “Milspec  Reform”  publi¬ 
cation,  the  USD[A&T]  singled  out  the  C- 
17  program’s  implementation  of  an  ISO 
9000  system  as  a  success,  resulting  in  “ad¬ 
vanced  schedule  deliveries,  cost  savings 
of  approximately  $100,000  per  aircraft, 
and  a  40  percent  reduction  in  government 
quality  inspection  work  force.” 


rrhe  AQS  resulted  in 
implroved  process 
metrics,  reduced 
cycle  time  to  imple¬ 
ment  corrective 
action,  increased 
focus  on  designing 
and  building  in 
quality,  and  continu¬ 
ous  reduced  process 
variability." 
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Communication— 

A  "Vision"  For  Success 


"Timely  cemmuni- 
calien  that  clearly 
articuialed  the 
Issues,  concerns, 
and  problems 
proved  essential  to 
the  C-17  program's 
turnaround." 


Timely  communication  that  clearly  ar¬ 
ticulated  the  issues,  concerns,  and  prob¬ 
lems  proved  essential  to  the  C-17 
program’s  turnaround.  This  was  a  monu¬ 
mental  task,  considering  the  number  of 
major  and  minor  subcontractors,  as  well 
as  the  myriad  of  parts  suppliers  support¬ 
ing  the  program.  The  DCMC  tackled  this 
problem  by  expanding  the  “partnership” 
to  include  all  the  major  and  minor  suppli¬ 
ers.  A  customer 
service  center 
was  established 
at  Long  Beach 
to  “maintain 
communica¬ 
tions  and  team¬ 
work  on  the  part 
of  all  of  the  sup¬ 
pliers  and  gov¬ 
ernment  organi¬ 
zations  managing  the  C-17  program.” 
This  included  institutionalizing  a  formal 
structure  for  reporting  issues,  problems, 
required  actions,  and  successes.  The  re¬ 
ports  were  consolidated  into  a  keystone 
document  called  Vision — C-1 7  Employed 
Around  the  World. 

The  report  provided  a  detailed,  exten¬ 
sive  look  into  the  program’s  status  from  a 
manufacturing  and  program  integration 
view.  It  included  a  “quick  look”  (execu¬ 
tive  summary)  section  followed  by  con¬ 
tract  performance,  product  team  perfor¬ 
mance,  subcontracting  management,  and 
system  program  integration  (SPI)  sections. 
The  executive  summary  provided  a  quick 
program  overview  to  include  major  issues 
relating  to  cost,  schedule,  and  perfor¬ 


mance.  The  contract  performance  section 
provided  a  detailed  look  at  cost  and  sched¬ 
ule,  estimate  at  completion,  progress  pay¬ 
ments,  contract  modifications,  safety/for¬ 
eign  object  debris,  and  the  health  of  busi¬ 
ness  and  technical  systems.  The  product 
team  performance  section  provided  exten¬ 
sive  insight  into  aircraft  systems  (avion¬ 
ics,  flight  controls,  mission  equipment, 
and  airframe),  flight  operations,  air  vehicle 
integration,  and  PBM.  The  subcontract 
management  section  provided  a  brief  over¬ 
view  of  the  status  of  major  suppliers  to 
include  component  descriptions,  issues, 
and  delivery  and  quality  ratings  (red  =  un¬ 
satisfactory;  yellow  =  marginal;  green  = 
satisfactory).  The  SPI  section  provided  an 
extremely  thorough  analysis  of  program 
status  at  38  major  suppliers,  to  include 
cost,  delivery,  quality,  and  program  rat¬ 
ing.  Most  important,  the  report  identified 
the  key  issues  affecting  performance  that 
required  action. 

The  customer  service  center  prepared 
the  Vision  report  monthly.  The  document 
was  forwarded  to  key  agencies  for  review 
and  action  as  required.  The  center  tracked 
the  issues  to  ensure  timely  resolution,  and 
thus  ensured  the  elimination  of  roadblocks 
to  program  execution  and  greater  customer 
satisfaction. 


Lessons  Learned 


The  story  of  the  C-17  program’s  re¬ 
markable  turnaround  highlights  lessons 
learned  that  could  benefit  other  programs. 
Among  the  most  important  of  these  are: 

Never  count  on  divine  intervention. 
The  settlement  between  McDonnell  Dou¬ 
glas  and  the  Air  Force  allowed  the  con- 
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tractor  to  begin  with  a  clean  slate.  It  was 
the  major  catalyst  that  fostered  better  com¬ 
munication  and  teamwork  between  the 
SPO  and  McDonnell  Douglas.  Nonethe¬ 
less,  it  required  an  extraordinary  lining  up 
of  the  Congressional,  OSD,  and  service 
“planets”  that  was  extremely  rare  and  un¬ 
likely  to  happen  again. 

Integrated  product  teams  and  the 
PEO  system  work.  The  teamwork  that 
IPTs  fostered  proved  invaluable,  in  part 
due  to  the  fact  that  they  were  genuinely 
empowered  by  Kadish  and  Kozlowski. 
The  teams  aggressively  attacked  and 
achieved  the  program  goals  that  the  lead¬ 
ership  laid  out.  Major  General  Childress 
and  his  staff  did  a  masterful  job  conduct¬ 
ing  the  DAB  process,  and  “running  top 
cover”  in  Washington,  enabling  the  SPO 
to  concentrate  its  effort  on  program  ex¬ 
ecution.  His  savvy  development  of  an  ex¬ 
ecutable  NDAA  alternative  put  the  weight 
of  competition  onto  McDonnell  Douglas, 
and  tangibly  helped  them  get  their  act  to¬ 
gether. 

Other  lessons  are: 

•  Enlist  the  vocal  support  of  your  cus¬ 
tomer.  Keeping  the  Army  well  in¬ 
formed  and  deeply  involved  proved 
vital  to  program  success. 

•  Assign  action  officers  to  orchestrate  a 
Milestone  III  DAB  at  least  one  year  in 
advance.  This  proactive  approach 
served  to  get  “buy-in”  from  key  OSD 
participants  early  on,  and  gave  them  a 
sense  of  ownership  in  the  success  of 
the  C-17  program. 

•  A  process  approach  to  manufacturing 
is  extremely  valuable;  it  allows  prob¬ 
lems  to  be  fixed  at  their  source.  Root 


cause  analysis  helped  participants  to 
focus  on  the  problem’s  source,  elimi¬ 
nating  bottlenecks  to  program  progress. 


Concentrate  on  a  series  of  challenging 
yet  achievable  goals,  and  harness  the 
energy  of  the  combined  contractor- 
SPO  team  to  attain  them.  Once  at¬ 
tained,  establish  a  new  set  of  goals.  Pro¬ 
gram  goals  and  objectives  must  flow- 


"Ultimalely,  all 
Improvement  bells 
down  fe  the 
centracter^s  ability 
te  perform." 


down  into 
integrated 
plans  and 
schedules. 

Hold  IPT 
leaders  ac¬ 
countable 
for  achieve¬ 
ment  of  their  part  of  each  goal.  A  well¬ 
functioning  team  will  include  four  tiers 
of  members.  First-order  members  are 
the  contractor,  plant  representatives, 
and  SPO;  second-order  members  are 
the  SPO,  PEO/mission  area  director, 
and  service  staffs;  third-order  members 
are  the  OSD;  and  the  fourth  order  is 
Congress. 


•  Use  the  public  affairs  office  to  develop 
a  plan  to  disseminate  the  good  news.  It 
proved  useful  to  get  VIPs  involved,  al¬ 
low  them  to  fly  on  the  C-17,  and  to  let 
them  hear  the  opinions  of  the  people 
actually  using  the  aircraft — both  AMC 
aircrews  and  maintainers  and  Army 
soldiers. 


Ultimately,  all  improvement  boils  down 
to  the  contractor’s  ability  to  perform. 
McDonnell  Douglas’  performance  im¬ 
proved  at  a  rapid  rate  throughout  the  re¬ 
covery  cycle  of  the  program.  The  com¬ 
pany  began  to  routinely  deliver  high-qual- 
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ity  C-17s  ahead  of  schedule.  Take  charge! 
Seize  the  high  ground  on  every  issue.  This 
includes  issues  other  than  just  the  ones  you 
think  you  own.  Finally,  a  brief  array  of 
Gen.  Colin  Powell’s  “rules”  apply  in  the 


C-17’s  case;  “It  ain’t  as  bad  as  you  think.” 
“It  will  look  better  in  the  morning.”  “It 
can  be  done.”  “Check  small  things.” 
“Share  credit.”  “Have  a  vision.”  “Be  de¬ 
manding.” 


Col  Randy  Davis,  USAF,  LTC  Bill  Phillips, USA,  and  Lt  Col  Bud  Vazquez,  USAF,  wrote  this  paper 
as  part  of  their  course  work  for  the  Senior  Acquisition  Course  (SAC),  a  highly  selective  part  of 
the  National  Defense  University’s  Industriai  Coilege  of  the  Armed  Forces  (iCAF)  curricuium.  At 
the  time  of  their  experiences,  Coionei  (seiect)  Davis  ied  an  integrated  Product  Team  at  Wright- 
Patterson  AFB’s  C-17  Program  Office,  LTC  Phillips  commanded  the  DCMC  McDonneii  Dou¬ 
glas  Huntington  Beach,  CA,  facility  (plant  representative  office),  and  Lt  Coi  Vazquez  was  the 
director  of  airlift  programs  for  the  Air  Force’s  Program  Executive  Officer  for  Tacticai  and  Airiift 
programs  in  the  Pentagon. 
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ENDNOTES 


1.  The  original  contract  specifications 
were  written  to  capture  the  C-17  per¬ 
formance  proposed  by  McDonnell 
Douglas  during  the  source  selection. 
However,  these  were  very  much  in  ex¬ 
cess  of  actual  Air  Force  requirements 
stated  at  the  time. 


2.  PBM  is  a  management  system  propri¬ 
etary  to  McDonnell  Douglas.  Permis¬ 
sion  was  granted  for  use  in  this  article. 
For  further  information  about  PBM, 
contact  McDonnell  Douglas. 
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A  PROGRAM  MANAGER  TALKS: 
WHAT  CONTRACTORS  SHOULD  KNOW 

Deanna  i,  Bennett 


In  July  1997  U.S.  Special  Operations  Command  (USSOCOM)  awarded  three 
systems  engineering  and  technical  assistance  (SETA)  support  contracts.  Each 
contract  has  a  $150  million  ceiling  over  the  five-year  contract  life.  The 
contractors  were  selected  under  a  formal  acquisition  process.  Some  new 
strategies  available  under  acquisition  reform/streamlining  were  used  in  the 
solicitation  and  evaluation. 

My  recent  experience  as  the  program  manager  for  USSOCOM’s  SETA 
acquisition  has  shown  me  that,  despite  the  drive  for  open  government 
communication  and  despite  the  years  of  contractors  competing  under 
substantially  the  same  rules  (with  some  adjustments  at  the  margin  because  of 
acquisition  reform  and  streamlining),  too  many  contractors  continue  to  hold 
misapprehensions  about  the  government  competitive  acquisition  process, 
penalize  themselves  through  lack  of  understanding  of  the  process,  and  make 
tactical  as  well  as  factual  mistakes  in  the  proposal  preparation  and  discussion 
processes. 


The  purpose  of  the  competitive  ac¬ 
quisition  process  is  not  to  weed  out 
the  unqualified  (though  this  occurs 
as  a  by-product  of  the  process)  but  to  be 
able  to  make  an  informed  selection  from 
competent,  qualified  competitors.  The  pur¬ 
pose  of  this  article  is  to  share  some  of  the 
lessons  Fve  learned  over  my  25-year  ca¬ 
reer  in  the  Department  of  Defense  (DoD) 
acquisition  business  about  what  contrac¬ 
tors  do  wrong,  specifically  with  respect 
to  services  type  contracts,  so  they  can  be¬ 
come  better  competitors  in  the  acquisition 
process.  Although  my  USSOCOM  SETA 


acquisition  experience  precipitated  this  ar¬ 
ticle,  the  examples  and  observations  I 
make  follow  from  the  large  number  of 
acquisitions  I’ve  been  associated  with 
during  my  career. 

Understand  The  Acquisition  Process 
Face  Time  Doesn't  Count 

This  is  a  truth  much  denied  in  practice 
by  industry.  The  formal  acquisition  pro¬ 
cess  is  built  on  objective  evaluation  of  the 
proposal.  Presenting  information  briefings 
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and  getting  “face  time”  with  the  program 
manager  or  the  source  selection  authority 
or  anyone  else  you  presume  is  involved 
in  the  process  counts  for  nothing  in  the 
acquisition  process.  It  isn’t  your  market¬ 
ing  manager  or  program  manager  but  your 
proposal  that  talks.  (On  the  other  hand,  do 
take  every  opportunity  in  all  forums  to 
gain  information  about  the  customer’s  re¬ 
quirements.) 

Play  by  the  Rules 

There  is  a  way  to  negatively  influence 
the  government’s  perception  of  your  com¬ 
pany  and  possibly  elicit  unwanted  govern¬ 
ment  attention  for  your  company.  That  is 
to  attempt  to  get  additional  or  insider  or 
advance  information  about  the  proposal 
or  its  details.  Word  does  get  back  to  the 
contracting  officer  if  a  contractor  has  con¬ 
tacted  government  personnel  to  elicit  in¬ 
formation,  and  your  company  will  receive 
direction  from  the  contracting  officer  to 
play  by  the  rules. 

Understahd  the  Basic  Process 

The  basic  underpinnings  of  the  acqui¬ 
sition  process  are  objectivity  and  fairness. 
All  offerors  submit  proposals  against  the 
same  Request  for  Proposal  (RFP)  contain¬ 
ing  the  same  statement  of  work  and  the 
same  proposal  instmctions.  All  offerors 
are  evaluated  against  the  same  objective 
evaluation  criteria.  The  selection  is  made 


based  on  the  criteria  established  by  the 
program  office  and  published  in  the  RFP. 
In  general,  at  the  most  detailed  level  of 
evaluation,  technical  proposals  are  evalu¬ 
ated  by  individuals  who  have  no  access  to 
the  cost  proposal.  Cost  and  other  sections 
of  proposals  are  evaluated  separately.  At 
the  next  higher  level,  the  results  of  all  fac¬ 
ets  of  the  evaluation  (e.g.,  technical,  cost, 
management,  past  performance)  are  re¬ 
viewed  to  give  a  full  understanding  of  each 
proposal,  proposals  are  compared  with 
each  other  (using  the  results  of  evaluation 
against  the  objective  evaluation  criteria), 
and  a  recommendation  for  award  is  made. 
The  Source  Selection  Authority,  the  high¬ 
est  level  in  the  process,  uses  all  the  infor¬ 
mation  and  the  recommendation  in  decid¬ 
ing  on  contract  award. 

Get  as  Much  Ihformatioh 
Up  Front  as  Possible 

Have  the  right  people  in  the  loop  to 
gather  the  information.  If  there  is  a  pre¬ 
solicitation  conference  or  a  pre-proposal 
conference  or  other  forum  for  information 
exchange  between  the  government  and 
industry,  have  your  program  manager  and 
contracts  people  attend,  not  just  your  mar¬ 
keting  manager.  (See  “Face  Time  Doesn’t 
Count”  above.)  Regularly  access  the 
agency’s  Web  pages  for  up  to  date  infor¬ 
mation.  If  you  have  questions,  ask  in  what¬ 
ever  forum  is  available. 


Deanna  J.  Bennett  is  a  program  manager  in  the  Speciai  Operations  Acquisition  and  Logistics 
Center,  U.S.  Speciai  Operations  Command.  She  hoids  a  B.A.  degree  in  economics,  an  M.A. 
degree  in  politicai  science,  and  a  Master  of  Public  Administration  degree.  She  is  a  graduate  of 
the  Defense  Systems  Management  College’s  PMC  93-1  course  and  is  a  Defense  Acquisition 
Corps  member  certified  at  Level  III  in  both  program  management  and  communications-com- 
puter  systems. 
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Read  the  Solicitation 

The  three  most  important  parts  of  any 
RFP  that  are  essential  to  understanding  the 
process  applicable  to  any  competitive  ac¬ 
quisition  are  Sections  L  and  M  and  the 
Statement  of  Work.  Read  and  understand 
these  completely.  There  will  be  a  quiz — 
it’s  your  proposal! 


Prepare  a  Sound  Proposal _ 

Understand  What's  in  Section  L 

Section  L  contains  proposal  instruc¬ 
tions.  If  there  are  page  limitations  on  all 
or  parts  of  your  proposal  and  direction 
regarding  type  fonts,  diagrams,  and  illus¬ 
trations,  they  will  be  in  Section  L.  Sec¬ 
tion  L  also  defines  proposal  format  and 
structure:  what  information  should  be  con¬ 
tained  in  what  format  and  in  which  vol¬ 
ume  of  your  proposal.  Importantly,  Sec¬ 
tion  L  also  defines  the  substance  of  the 
proposal. 

Don't  NIake  Avoidable  Section  L 
Mistakes 

Read  the  instructions  carefully!  Too 
many  times  offerors  make  simple  mistakes 
resulting  from  not  following  instructions 
contained  in  Section  L.  Most  often  the 
result  is  a  lower  evaluation  rating.  There 
are  a  number  of  easily  avoidable,  but  com¬ 
mon  mistakes. 

Exceeding  page  limits.  A  page  limit 
seems  like  a  very  simple  instruction  to 
follow;  however,  occasionally  an  offeror 
will  waste  time  and  effort  to  produce  pages 
that  are  never  seen  by  any  evaluator.  Any¬ 
thing  submitted  above  the  page  limit  is 
removed  from  your  proposal  and  disre¬ 
garded  in  the  evaluation  process.  Some¬ 


times  the  pages  are  sent  back  to  you.  An¬ 
other  strategy  used  is  equally  futile:  You 
cannot  get  around  a  page  limit  by  refer¬ 
encing  another  part  of  the  proposal  con¬ 
taining  additional  information.  The  evalu¬ 
ation  teams  will  evaluate  only  the  speci¬ 
fied  number  of  pages  in  their  assigned  sec¬ 
tion  of  the  proposal.  Write  to  the  point  and 
fit  into  the  allotted  page  limit. 

Putting  information  in  the  wrong 
place.  This  has  the  same  effect  as  submit¬ 
ting  too  many  pages.  For  example,  put¬ 
ting  footnotes  in  your  cost  proposal  that 
expand  on  or  clarify  fine  points  in  your 
technical  proposal  for  a  services  type  of 
contract  may  have  no  effect  on  technical 
evaluation:  Technical  evaluation  teams 
have  no  access  to  the  cost  proposals  and 
may  never  see  the  footnotes. 

Assuming  evaluation  team  osmosis. 
Putting  something  in  one  section  of  a  pro¬ 
posal  does  not  guarantee  that  evaluators 
of  another  sec¬ 


tion  will  read  or 
be  aware  of  it 
through  some 
kind  of  team 
mental  osmosis. 
For  example,  if 
a  particularly 
innovative  pro- 


L  three  most 
impertanl  parts  of 
any  RFP  that  pire 
essential  to  under¬ 
standing  the  pro¬ 
cess  applicable  te 
any  competitive 
acquisition  are 
Sections  L  and  M 


cess  is  proposed  and  the  Statement 


that  bears  both  of  Work." 


on  the  overall 

management  of  contract  performance  and 
on  a  production  process,  describing  it  only 
in  the  management  proposal  may  mean 
that  the  technical  evaluators  are  com¬ 
pletely  unaware  of  it  or  its  applicability  to 
the  production  process.  Your  proposal  may 
fail  to  receive  credit  for  your  innovation. 
Or  you  may  have  to  amend  your  proposal 
during  the  negotiation  process  so  that  the 
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technical  evaluators  have  a  clear  under¬ 
standing  of  your  complete  strategy.  If 
there  are  page  limits  and  restrictions  on 
proposal  amendment  such  as  we  had  in 
USSOCOM’s  SETA  solicitation,  this  can 
be  a  serious  oversight. 

Not  addressing  all  proposal  require¬ 
ments.  It  seems  to  be  common  sense  to 
address  all  requirements  in  your  proposal, 
but  this  is  an  egregious  and  too-frequent 
proposal  error.  You  must  provide  whatever 
information  the  RFP  requests  in  the  speci¬ 
fied  location  and  format.  If  the  instmctions 
for  your  proposal  say  to  address  all  the 
issues  in  paragraph  3. a,  specifically  ad¬ 
dress  all  the  issues  in  paragraph  3. a.  If  the 
instructions  say  to  provide  a  diagram  of  a 


''The  most  effective 
and  efficient  way  to 
respond  to  solicita¬ 
tions  that  require 
distinctly  separated 
kinds  of  expertise 
may  he  to  assign 
parts  of  the  prepos- 
ais  to  subcontractors 
to  prepare." 


process,  pro¬ 
vide  a  diagram 
of  the  process. 
Not  doing  so 
immediately 
provides  an  ad¬ 
vantage  to  your 
competitors 
who  can  read 
and  follow  in¬ 
structions.  Fur- 


ther;  it  may  gen¬ 
erate  evaluation  weaknesses  or  deficien¬ 
cies  for  your  proposal  that,  depending  on 
the  specific  source  selection  process,  may 
or  may  not  be  recoverable.  Before  sub¬ 
mission  do  a  traceability  matrix  of  Sec¬ 
tion  L  requirements  against  your  proposal 
and  make  sure  everything  is  there! 

Ignoring  personnel  qualiBcation  re¬ 
quirements.  Often  the  government’s 
Statement  of  Work  will  specify  labor  cat¬ 
egories  and  define  the  personnel  qualifi¬ 
cations  for  the  labor  category.  Once  a  con¬ 
tract  is  awarded,  there  is  latitude  to  occa¬ 
sionally  waive  an  educational  or  other  re¬ 


quirement  based  on  an  individual’s  unique 
experience  or  other  qualifications.  How¬ 
ever,  your  proposal  is  not  the  place  to  ig¬ 
nore  the  requirement  for  a  master’s  degree 
and  propose  the  maritime  design  genius 
who  only  has  a  high  school  education.  It 
will  count  against  you.  Read  the  educa¬ 
tion  and  experience  requirements  and 
make  sure  that  the  resumes  submitted 
against  each  category  clearly  show  that  the 
individuals  proposed  meet  these  require¬ 
ments. 

Don't  Pass  Oversight  Along  with 
Tasking  to  Subcontractors 

The  most  effective  and  efficient  way  to 
respond  to  solicitations  that  require  dis¬ 
tinctly  separated  kinds  of  expertise  may 
be  to  assign  parts  of  the  proposals  to  sub¬ 
contractors  to  prepare.  This  could  be  done 
easily  with  the  four  distinct  sample  tasks 
we  issued  in  the  SETA-II  solicitation.  It 
is  especially  important  with  new  subcon¬ 
tractors  that  you  do  not  pass  oversight  re¬ 
sponsibility  along  with  the  task.  Ensure 
that  as  the  prime  contractor  you  subject 
the  subcontractor-prepared  parts  of  the 
proposal  to  the  same  rigorous  manage¬ 
ment  oversight  and  “red  team”  (in-house 
adversarial  review)  as  the  work  you  re¬ 
tain.  If  you  use  groupware  for  networked 
proposal  development,  make  the  subcon¬ 
tractor  use  the  same  system  and  give  you 
access  to  it  so  you  can  perform  progress 
and  reality  checks  along  the  way  without 
impeding  the  process.  An  unsupervised 
subcontractor  can  cripple  the  proposal  of 
the  prime. 

Plan  on  Working  Holidays 

It  is  not  a  deliberate  plot  on  the  part  of 
the  government,  but  prime  time  for  release 


438 


4  Program  Manager  Talks:  What  Contractors  Should  Know 


of  solicitations  for  award  of  operations  and 
maintenance  (O&M)  funded  Contract 
Advisory  and  Assistance  Services 
(CAAS)  contracts  tends  to  be  September 
through  December.  This  is  so  contracts  can 
be  awarded  in  the  March  to  June  time 
frame.  There  is  a  fiscal  year  funds  flow 
that  makes  this  optimum.  First,  the  amount 
of  contract  funding  that  is  available  is  not 
known  for  certain  until  the  budget  is 
passed  (which  has  no  better  than  a  50-50 
chance  of  occurring  by  the  required  Oc¬ 
tober  1  date),  and  second,  it  takes  time  for 
the  government  funds  distribution  process 
to  make  these  funds  available  to  spend. 
Because  of  the  budget  cycle  interruptions, 
executing  new  contracts  in  the  October 
through  December  period  is  difficult  to 
accomplish  and  rarely  planned,  especially 
for  new  services  types  of  contracts.  Also, 
in  the  DoD  O&M  funds  expire  at  midnight 
on  September  30,  so  planning  an  award 
in  March  to  June  gives  the  government  4 
to  6  months  in  which  to  expend  the  cur¬ 
rent  year  funds  under  contract  and  get  util¬ 
ity  from  the  contract  before  having  to  do 
the  administrative  contract  work  to  exer¬ 
cise  the  next  year’s  contract  option.  This 
funding  cycle  never  makes  for  a  Merry 
Christmas  for  industry. 


its  own  mles  within  the  overall  acquisi¬ 
tion  requirements  and  regulations  and  al¬ 
ways  defines  the  process  and  the  basis  for 
award  in  Section  M  of  the  Request  for  Pro¬ 
posal.  For  example,  solicitations  often 
present  opportunities  to  offerors  to  sub¬ 
mit  proposal  changes  to  repair  deficien¬ 
cies  the  govern¬ 
ment  has  found 
during  proposal 
evaluation.  This 
was  different  in 
USSOCOM’s 
SETA  acquisi¬ 
tion.  A  substan¬ 
tial  part  of  our 
evaluation 
rested  on  the  re¬ 
sponses  to  four 
sample  tasks 
that  represented 

core  support  requirements  for  the  com¬ 
mand.  In  order  to  preclude  technical  lev¬ 
eling,  we  did  not  permit  changes  to  the 
responses  to  these  tasks  and  so  indicated 
in  Section  M  of  our  RFP.  Anyone  who 
assumed  they’d  have  a  “get  well”  oppor¬ 
tunity  for  the  most  important  part  of  the 
technical/management  proposal  was 
wrong. 


"The  obiecthre  of  a 
competilive  range 
determinafion  is  te 
identify  proposals 
that  are  unlikely  to 
be  viable  cempeti- 
fers  for  contract 
award  and  remove 
them  from  further 
consideration  in  the 
evaluation  pro¬ 


cess 


IF 


Understand  How 
THE  Evaluation  Will  Work 


Know  What's  in  Section  M 

Understanding  Section  M  prevents  un¬ 
pleasant  surprises  later  on  and  should  form 
the  basis  for  your  proposal  strategy.  Sec¬ 
tion  M  always  defines  the  evaluation  cri¬ 
teria  and  the  relative  importance  of  the 
evaluation  criteria.  Each  solicitation  has 


How  to  Handle  Multiple  Competitive 
Range  DEnitMiNATioNS 

The  objective  of  a  competitive  range 
determination  is  to  identify  proposals  that 
are  unlikely  to  be  viable  competitors  for 
contract  award  and  remove  them  from 
further  consideration  in  the  evaluation  pro¬ 
cess.  Acquisition  streamlining  guidance 
suggests  progressively  decreasing  the 
number  of  competitors  through  multiple 
competitive  range  determinations  at  logi- 
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cal  points  in  the  source  selection  process. 
If  multiple  competitive  range  determina¬ 
tions  will  be  made,  Section  M  of  the  RFP 

will  inform  in- 

:"The  qwestions  are  dustry  of  the 
:  ndf  intended  to  "trip  ^  and  will 
;y*u  up"^  e^  provide  the  ba¬ 
the  plcqf ing  f ieid/'  sis  on  which 

but  to  seiicit  infer*  offerors  will  be 

jnntien  to  ensure  a  removed  from 

fair  and  compiete  competition  at 

evaluatien  occurs."  each  determina¬ 

tion.  Industry 
has  the  right  to  protest  such  decisions. 
Don’t  protest  unless  you  have  an  extraor¬ 
dinarily  compelling  case:  although  new¬ 
est  guidance  says  “when  in  doubt,  throw 
them  out,”  in  the  early  stages  of  competi¬ 
tion  the  government  tends  to  be  conser¬ 
vative  in  removing  contractors  from  com¬ 
petition:  Generally,  if  there’s  any  doubt,  a 
contractor  will  be  left  in.  Accept  an  early 
cut  from  the  competition  and  appreciate 
the  fact  that  it  is  a  way  of  saving  you  and 
the  government  time,  money,  and  effort 
that  have  a  significantly  high  probability 
of  being  futile.  Protesting  your  removal 
from  the  competition  will  only  run  up  le¬ 
gal  fees,  delay  the  acquisition  process,  and 
almost  certainly  guarantee  merely  delay¬ 
ing  your  loss  of  the  competitive  award  to 
a  later  date.  In  any  case,  do  request  a  de¬ 
briefing  either  at  the  time  you  are  removed 
from  competition  or  after  final  contract 
award  (when  data  on  winning  proposals 
is  available)  to  leam  where  you  were  de¬ 
ficient. 

STRAncizi  Based  on 
THE  Evaluation  Criteria 

Section  M  defines  proposal  evaluation 
criteria  and  their  relative  importance  in 
making  the  source  selection.  Naturally  an 


offeror  will  want  to  submit  a  proposal  that 
receives  a  high  evaluation  rating  in  all  ar¬ 
eas.  But  when  time  gets  short,  invest  your 
proposal  preparation  and  quality  control 
efforts  where  they  will  count  most.  Ex¬ 
cept  in  some  special  situations  (e.g.,  sealed 
bid),  the  government  has  gone  away  from 
the  low  bid  mentality.  Generally  you  will 
find  technical  or  management  approach  or 
a  combination  being  the  most  important 
factor  in  source  selection,  with  cost  ranked 
somewhere  lower.  As  you  constract  your 
proposal  and  red-team  it,  emphasize  the 
completeness,  accuracy,  and  level  of  de¬ 
tail  in  the  parts  of  the  proposal  that  will 
count  most  toward  source  selection.  The 
fact  that  your  proposal  is  the  low-cost  pro¬ 
posal  is  irrelevant  if  the  most  important 
factor  is  the  technical  response  and  your 
technical  proposal  is  inferior  to  those  of 
your  competitors. 

Respond  Fully  to  Government  Questions 

The  government  may  provide  questions 
intended  to  clarify  your  proposal  or  enter 
into  formal  discussions  with  you  to  per¬ 
mit  you  to  amend  your  proposal  and  clear 
deficiencies.  It  is  important  that  you  re¬ 
spond  fully  and  completely.  The  objectives 
of  these  interchanges  are  to  allow  the 
evaluators  to  fully  understand  your  pro¬ 
posal  and  to  allow  the  government  to  have 
a  choice  among  fully  qualified  offerors. 
The  questions  are  not  intended  to  “trip  you 
up”  or  “level  the  playing  field,”  but  to  so¬ 
licit  information  to  ensure  a  fair  and  com¬ 
plete  evaluation  occurs. 

Give  Yourself  Flexibility  in  Oral 
Proposals 

Carefully  read  the  rules  pertaining  to 
oral  presentations  in  sections  L  and  M; 
understand  how  the  orals  will  work;  pre- 
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pare  for  oral  presentations  at  the  detail 
level;  but,  provide  the  government  higher 
level  advance  information.  This  will  give 
you  some  flexibility,  even  under  a  “no 
amendment”  situation.  In  USSOCOM’s 
SETA  acquisition  we  required  submission 
of  hard  copies  of  slides  to  be  used  in  the 
oral  presentations  as  part  of  proposals  and 
offered  the  option  of  also  submitting 
bulleted  talking  notes.  The  intention  was 
to  prepare  the  evaluators  by  giving  them 
an  opportunity  to  understand  the  general 
gist  of  the  proposal  before  actually  hear¬ 
ing  it  presented.  However,  some  submis¬ 
sions  were  in  such  great  detail  that  they 
virtually  constituted  a  written  proposal. 
These  proposals  locked  themselves  in. 
Since  no  amendment  to  orally  presented 
sample  tasks  was  permitted,  the  govern¬ 
ment  could  not  accept  corrections  or  up¬ 
dates  in  the  presentation  or  in  response  to 
questions  and  answers.  For  example,  if 
your  advance  slide  said  “300-person  da¬ 
tabase  of  qualified  technical  personnel” 
and  by  the  time  of  the  oral  presentations 
you  had  expanded  it  to  a  database  of  more 
than  1,000  qualified  technical  personnel, 


changing  the  number  would  constitute 
unacceptable  amendment.  However  had 
the  slide  and  notes  said  “large  personnel 
resource  database”  you  could  have  ex¬ 
plained  in  your  presentation  that  the  data¬ 
base  had  applications  from  1,000  people. 

Conclusion 


A  large  number  of  businesses  can  pro¬ 
vide  government  CAAS  support  services, 
so  there  is  serious  competition  for  these 
contracts.  The  acquisition  process  is  de¬ 
signed  to  support  an  informed  selection 
from  competent,  qualified  competitors. 
Simple  oversights  and  misunderstandings 
can  handicap  an  otherwise  acceptable  pro¬ 
posal.  Red  teams  or  other  internal  reviews 
can  be  used  to  ensure  a  complete,  thor¬ 
ough,  and  properly  focused  proposal  is 
submitted.  Acting  with  an  understanding 
of  acquisition  process  for  each  acquisition 
and  complying  fully  with  proposal  instrac- 
tions  will  enhance  an  company’s  ability 
to  compete. 
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TUTORIAL 


ESTIMATING  THE  HEAITH  HAZARD 
COSTS  OF  ARMY  MATERIEL: 

A  METHOD  FOR  HEIPINO  PROGRAM 
MANAGERS  MAKE  INFORMED  HEAITH 
RISK  DECISIONS 


Cary  M,  BraTt,  Donna  M.  Doganiero,  Clark  0.  Spencer 


We  have  developed  a  model  to  assist  the  U.S.  Army  estimate  weapon  system 
health  hazard  costs  based  on  the  probability  of  a  hazard  occurring  and  the 
severity  of  that  hazard.  We  linked  health  hazard  categories  to  types  of  clinic 
services  that  might  be  required  as  a  result  of  exposure  to  a  specific  health 
hazard;  and  diagnostic  categories  based  on  the  potential  medical  effects  that 
could  occur  as  a  result  of  exposure  to  a  specific  health  hazard.  We  researched 
incidence  rates  and  calculated  costs  based  on  industry-wide  data  on  injuries, 
lost  time,  hospitalization,  and  disability,  and  this  framework  provides  a  method 
to  reasonably  estimate  the  medical  and  lost  military  manpower  costs  of 
unabated  health  hazards  associated  with  Army  materiel.  Using  the  outputs  of 
the  model  will  increase  the  effectiveness  of  health  risk  assessment  and 
management,  and  better  enable  the  Army  to  eliminate  or  control  materiel  health 
hazards  and  control  life-cycle  costs.  Application  of  this  model  to  other 
prevention  disciplines  in  acquisition  and  preventive  medicine  will  provide 
decision  makers  with  invaluable  quantitative  information  regarding  cost 
avoidance. 


U.S.  Army  medical  personnel  cur¬ 
rently  conduct  health  hazard  as 
sessments  of  new  or  improved 
materiel.  They  assess  the  types  of  hazards 
that  exist;  the  injuries  or  illnesses  likely 
to  result  from  them;  the  level  of  health  risk 
for  each  hazard;  and  the  corrective  actions 


needed  to  eliminate  or  abate  the  hazard. 
Health  hazard  assessment  reports  provide 
this  information  to  the  materiel  program 
managers. 

We  have  developed  a  framework  for  a 
medical  cost  avoidance  model  (MCAM) 
that  provides  a  method  to  quantify  reason- 
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able  estimates  of  the  medical  and  lost  time 
costs  associated  with  unabated  Army  ma¬ 
teriel  health  hazards.  Use  of  the  model  will 
increase  the  effectiveness  of  health  risk 
assessment  and  management. 

It  seems  intuitive  that  health  hazard  in¬ 
tervention  and  prevention  activities  should 
significantly  ease  the  burden  on  the  health 
care  system  by  reducing  deaths,  disabili¬ 
ties,  lost  time  away  from  the  work  site, 
hospitalization,  clinical  medical  costs,  in¬ 
juries  and  illnesses,  and  rehabilitation 
costs.  For  years,  however,  the  preventive 
medicine  community  has  needed  a  way 
to  estimate  the  costs  avoided — a  critical 
step  in  the  prevention  process.  Given  the 
cost-conscious  environment  in  which  pro¬ 
gram  managers  make  their  decisions,  the 
need  to  quantify  health  hazard  costs  is  es¬ 
sential. 

We  developed  this,  the  first  version  of 
the  MCAM,  specifically  to  help  the  U.S. 


Army  estimate  the  health  hazard  costs  of 
materiel  systems.  It  quantifies  these  costs 
based  on  the  probability  of  a  hazard  and 
its  severity.  We  linked  health  hazard  cat¬ 
egories  to  potential  types  of  clinic  services 
that  might  be  required  as  a  result  of  expo¬ 
sure  to  a  specific  health  hazard,  and  diag¬ 
nostic  categories  based  on  the  potential 
medical  effects  that  could  occur  as  a  re¬ 
sult  of  exposure  to  a  specific  health  haz¬ 
ard.  We  then  used  this  information  to  de¬ 
termine  incidence,  distribution,  and  other 
rates  for  injury,  clinic  visits,  hospitalization, 
lost  time,  disability,  rehabilitation,  and  death. 
The  result  is  a  model  that  quantifies  ex¬ 
pected  costs  of  a  health  hazard.  This  model 
better  describes  a  stated  health  risk,  asso¬ 
ciated  lost  military  manpower,  and  mon¬ 
etary  impact  if  no  preventive  or  correc¬ 
tive  actions  occur.  We  do  not  address  other 
technical  or  programmatic  risks  that  ma¬ 
teriel  program  managers  must  face. 


Gary  M.  Bratt  earned  his  M.S.  degree  in  environmental  engineering  from  the  University  of 
North  Carolina  School  of  Public  Health  (Chapel  Hill).  He  is  a  retired  U.S.  Army  Medical  Service 
Corps  officer,  and  is  currently  a  research  fellow  with  the  Logistics  Management  Institute,  McLean, 
VA.  While  on  active  duty  he  was  a  an  advisor  to  the  Army  Surgeon  General  and  Army  Staff  on 
environmental  pollution  and  public  health  issues,  and  weapon  system  and  equipment  health 
hazard  issues.  His  current  focus  is  on  preventive  medicine  policy  and  strategy,  measures  of 
cost  and  effectiveness,  and  relating  medical  and  lost  time  costs  to  health  risk.  He  continues  to 
provide  support  to  the  U.S.  Army’s  health  hazard  assessment  program.  He  is  a  registered 
professional  engineer  in  the  state  of  Texas,  a  diplomate  of  the  American  Academy  of  Environ¬ 
mental  Engineers,  and  a  board-certified  industrial  hygienist  in  comprehensive  practice.  He  is 
currently  in  the  Naval  War  College  Seminar  Program. 

Donna  M.  Doganiero  is  the  Director  of  Occupational  Health  Sciences  at  the  U.S.  Army  Center 
for  Health  Promotion  and  Preventive  Medicine.  She  is  responsible  for  the  provision  of  occupa¬ 
tional  health  science  services  for  the  U.S.  Army  worldwide.  Many  of  her  programs  support  the 
U.S.  Army’s  health  hazard  assessment  program  in  the  Army  materiel  acquisition  decision  pro¬ 
cess.  She  has  an  M.S.  degree  in  environment  health/industriai  hygiene  from  Temple  University, 
and  an  M.S.  degree  in  human  genetics  from  Rutgers  University.  She  is  a  board-certified  indus¬ 
trial  hygienist  in  comprehensive  practice,  and  is  currently  on  the  board  of  directors  of  the  Ameri¬ 
can  Industrial  Hygiene  Association. 

Clark  0.  Spencer  earned  B.S.  degrees  In  biology  and  psychology  from  the  University  of  North 
Carolina  (Chapel  Hill).  He  Is  currently  a  research  fellow  with  the  Logistics  Management  Insti¬ 
tute,  McLean,  VA.  His  current  focus  is  on  environmental  and  occupational  health  information 
management  and  analysis  issues.  He  has  developed  numerous  software  applications  for  use 
by  the  U.S.  Army  environmental  and  occupational  health  communities. 
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We  are  presenting  the  model  to  stimu¬ 
late  thought  and  feedback;  it  can  and 
should  be  further  refined.  Based  on  our 
model.  Army  health  hazard  assessment 
reports  have  recently  begun  to  include  the 
medical  costs  for  injuries  or  illnesses  that 
will  result  from  the  hazards.  This  infor¬ 
mation  allows  materiel  program  manag¬ 
ers  to  understand  the  medical  costs  asso¬ 
ciated  with  their  systems,  and  in  turn  make 
informed  tradeoff  decisions  concerning 
corrective  actions.  The  model  is  currently 
available  as  a  personal  computer-based 
tool  that  can  perform  cost  calculations 
based  on  user  input. 

As  use  of  the  MCAM  continues  to  in¬ 
crease,  and  follow-up  data  become  avail¬ 
able,  we  can  develop  more  accurate  cost 
distribution  factors,  resulting  in  more  ac¬ 
curate  forecasts  of  health  costs. 


Health  Hazard  Assessments 


The  Army  performs  health  hazard  as¬ 
sessments  in  all  phases  of  the  acquisition 
process.  Eliminating  or  controlling  haz¬ 
ards  early  in  the  process  will  reduce  abate¬ 
ment  costs.  The  Army  assesses  materiel 
health  hazards  using  a  risk  assessment 
code  (RAC)  matrix  that  is  defined  in  Army 
Regulation  40-10,  “Health  Hazard  Assess¬ 
ment  Program  in  Support  of  the  Army 
Materiel  Acquisition  Decision  Process,” 
Oct.  1, 1991 .  This  matrix  is  similar  to  the 
ones  described  in  Army  Regulation  385- 
16,  “System  Safety  Engineering  and  Man¬ 
agement,”  Field  Manual  101-5,  “Staff 
Organization  and  Operations,”  and  De¬ 
partment  of  Defense  (DoD)  Instruction 
6055.1,  “DoD  Occupational  Safety  and 
Health  Program.”  DoD  has  been  using  this 


risk-based  method  to  prioritize  installation 
safety  and  health  hazards  for  abatement 
since  the  early  1980s. 

Assessing  Health  Risk 


Risk  per  se  is  a  probability  statement. 
The  term  “health  risk,”  however,  com¬ 
bines  the  severity  of  a  hazard’s  potential 
consequences  and  probability  of  exposure 
to  the  hazard. 

Before  assigning  a  health  risk  to  a  par¬ 
ticular  piece  of  equipment  or  materiel  sys¬ 
tem,  Army  evaluators  first  determine  the 
potential  hazards  operators  face.  In  their 
evaluation  they  also  consider  existing  con¬ 
trol  measures  to  minimize  exposure  to  the 
hazards.  Next,  they  assign  each  hazard  a 
relative  level  of  risk.  The  model  we 
present  here  incorporates  the  DoD  method 
for  assigning  “health  risk,”  which  com¬ 
bines  a  hazard’s  severity  and  probability. 
Hazard  severity  is  a  relative  score  that  re¬ 
flects  the  magnitude  of  exposure  to  physi¬ 
cal,  chemical,  or  biological  hazards  and 
the  severity  of  the  medical  effects  caused 
by  exposure  to  the  hazard.  Hazard  prob¬ 
ability  is  a  relative  score  that  reflects  the 
duration  of  the  exposure  and  the  number 
of  people  per  system  exposed  to  the  haz¬ 
ard.  The  hazard  severity  and  hazard  prob¬ 
ability  categories  are  shown  in  Table  1. 

The  risk  assessment  code  resulting  from 
the  combination  of  these  two  components 
can  range  from  1  (very  high  health  risk) 
to  5  (very  low  health  risk).  For  example, 
a  hazard  of  marginal  severity  (hazard  se¬ 
verity  =  III)  with  an  exposure  assessed  as 
probable  (hazard  probability  =  B)  has  a 
moderate  overall  risk  (RAC  =  3). 
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Measuring  Costs 


To  quantify  the  two  components  of  this 
risk  assessment  score,  hazard  severity  (Sj^) 
and  hazard  probability  (P^),  for  use  as  cost 
drivers  in  our  model,  we  developed  a  value 
for  each  severity  and  probability  category 
based  on  the  subjective  interpretation  of 
the  written  category  descriptions  in  the 
regulations.  These  values  are  shown  in 
Table  1  in  parentheses. 

To  measure  total  medical  costs  for  a 
particular  system,  assessors  must  know  the 
number  of  systems  (N )  that  will  be  pro¬ 
cured  or  are  in  the  inventory  and  the  num¬ 
ber  of  soldiers  or  crew  size  per  system 
(Np^).  Because  the  Army  uses  this  matrix 
for  determining  system  health  risk,  our 
intent  was  to  quantify  the  costs  associated 
with  each  RAC.  Table  1  presents,  for  a 
hazard  in  a  sample  system — the  number 
of  systems  (N^)  =  7400  and  the  number  of 
soldiers  per  system  (N^^)  =  4. — the  total 
costs  the  Army  will  incur  as  a  result  of 
not  abating  the  hazard  for  each  RAC  in 
the  matrix.  For  example,  we  can  see  that 


if  a  hazard  assessor  assigned  a  hazard  se¬ 
verity  of  I  and  a  hazard  probability  of  A, 
the  resulting  RAC  1  relates  to  a  total  cost 
incurred  of  $  1 5,088,000  per  year.  Program 
managers  can  make  better  tradeoff  health 
risk  decisions  knowing  the  dollar  impact 
in  addition  to  RACs.  Our  procedure  for 
calculating  cost  is  the  focus  of  this  article. 

Often  it  is  not  possible  to  eliminate  a 
health  hazard,  even  by  appropriate  con¬ 
trols.  Even  with  a  controlled  hazard  there 
is  a  health  risk.  This  residual  risk  is  what 
remains  after  controlling  a  health  hazard. 
One  can  determine  avoided  costs  by  sub¬ 
tracting  the  residual  cost  of  a  hazard  from 
its  unabated  cost.  For  example,  with  a  haz¬ 
ard  assigned  a  hazard  severity  of  I  and  a 
hazard  probability  of  A,  the  resulting  RAC 
1  relates  to  a  total  cost  incurred  of 
$15,088,000  per  year.  If  design  changes 
result  in  a  hazard  severity  of  III  and  a  haz¬ 
ard  probability  of  A,  the  resulting  RAC  2 
(residual  risk)  relates  to  a  total  cost  in¬ 
curred  of  $137,000.  The  avoided  costs 
therefore  are  $15,088,000  minus  $137,000 
equals  $14,  951,000  per  year. 


Table  1. 

Risk  Assessment  Codes  (RAC)  and  Costs  (Thousands  of  Dollars)  Matrix 


Hazarid  Severity  (SJ 

Hazard  Probability  (PJ 

Frequent 

Probable 

Occasional 

Remote 

Improbable 

A  (.9) 

B(.5) 

C(.2) 

D  (.01) 

E  (.001) 

1(1) 

Catastrophic 

1  ($15,088) 

1  ($8,471) 

1  ($3,508) 

2  ($365) 

3  ($216) 

II  (.1) 

Critical 

1  ($1,410) 

1  ($783) 

2  ($313) 

3  ($16) 

4($1) 

111  (.01) 

Marginal 

2  ($137) 

3  ($76) 

3  ($30) 

4  ($2) 

5  ($0,152) 

IV  (.001) 

Negligible 

3  ($13) 

5  ($7) 

5  ($3) 

5  ($0,148) 

5  ($0,015) 

Notes:  The  calculations  are  based  on  a  high  risk  system.  The  numbers  1, 2, 3, 4,  and  5,  in  the  columns  under 
Hazard  Probability  are  the  RACs.  The  numbers  in  parentheses  in  the  columns  under  Hazard  Probability  are 
the  medical  costs  that  are  incurred  for  a  given  RAC  if  no  intervention  occurs. 
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Figure  1.  Cost  Cempenenls  for  a  Single  Hazard 


•  lose  time  away  from  the  job  due  to 
clinic  and  hospital  appointments,  as¬ 
signment  to  quarters,  and  inability  to 
perform  on  the  job  (lost  time  costs,  Cj); 

•  experience  disability,  either  immedi¬ 
ately  while  on  active  duty  or  at  a  later 
date  after  discharge  or  retirement  (dis¬ 
ability  costs,  C^j); 

•  require  rehabilitation  because  of  dis¬ 
ability  (rehabilitation  costs,  C_,);  and 

•  suffer  death  as  a  result  of  exposure  se¬ 
verity  or  complications  (death  costs, 

CJ- 

Because  of  funding  constraints,  this 
initial  version  of  the  MCAM  did  not  in- 


Methods _ _ 

The  Cost  Model  Framework 

We  developed  the  framework  in  Fig¬ 
ure  1  for  determining  costs  based  on  six 
cost  components  that  result  from  exposure 
to  hazards  that  cause  illness,  injury,  or 
death. 

Six  basic  events  can  occur  when  a  sol¬ 
dier  becomes  ill  or  injured.  He  or  she  may: 

•  visit  a  medical  clinic  for  basic  outpa¬ 
tient  treatment,  medication,  and  tests 
(clinic  costs,  C^); 

•  visit  a  hospital  for  inpatient  observa¬ 
tion,  emergency  or  definitive  treatment, 
and  more  detailed  tests  (hospitalization 
costs,  C. ); 


447 


Acquisition  Review  Quarterly — Fall  1997 


corporate  the  costs  to  acquire  and  train 
personnel  replacements  for  those  soldiers 
injured,  ill,  or  killed.  We  also  did  not  in¬ 
corporate  performance  degradation  costs 
or  the  nonmonetary  effect  on  readiness. 
Nor  did  we  incorporate  the  costs  related 
to  the  impact  on  family  quality  of  life. 
These  costs  could  be  substantial  and 
should  be  considered  by  the  system  pro¬ 
gram  manager.  We  recognize  that  these 
costs  may  vary  greatly;  for  example,  it 
costs  more  to  train  a  pilot  than  an  Infan¬ 
tryman.  We  believe  the  system  program 
manager  is  in  the  best  position  to  judge 
the  magnitude  and  impact  of  these  addi¬ 
tional  costs. 

We  used  industry-wide  incidence  rates, 
distribution  factors,  and  other  rates  for 
injury,  hospitalization,  lost  time,  disabil¬ 
ity,  rehabilitation,  and  death  to  quantify 
health  hazard  costs  for  each  of  the  six  cost 
components.  The  model  estimates  the  total 
cost  per  year  for  exposures  to  hazards  that 
result  in  illness,  injury,  or  death,  and  can 
be  expressed  in  equation  form  as  follows: 

Hazard  costs/year  = 
clinic  costs/year  +  hospitalization 
costs/year  +  lost  time  costs/year 
+  disability  costs/year  -i-  rehabili¬ 
tation  costs/year  +  death  costs/ 
year. 

Assumptions 

We  made  two  primary  assumptions: 
The  first  was  that  we  could  establish  the 
incidence  rates — the  rate  of  injury  or  ill¬ 
ness  in  a  group  over  a  period  of  time — 
based  on  historical  industry-wide  data. 
Second,  we  assumed  that  a  medical  asses¬ 
sor  conducted  the  risk  assessment  prop¬ 
erly. 


We  developed  incidence  rates  from 
comparable  industry-wide  data  that  were 
available  during  model  development,  be¬ 
cause  not  all  the  required  data  were  avail¬ 
able  or  accessible  via  military  sources. 
This  required  that  we  extrapolate  from 
private  industry  data  and  relate  it  to  mili¬ 
tary  systems.  The  risk  assessment  codes 
used  in  this  article  were  determined  by 
experienced  health  hazard  assessors.  The 
assignment  of  a  RAC,  with  its  associated 
hazard  probability  and  hazard  severity,  is 
the  critical  element  in  communicating 
health  risk  to  program  managers.  Incor¬ 
rect  assessments  may  result  in  inaccurate 
cost  modeling. 

Hazard  Severity  and  Hazard  Probability 

Because  we  could  not  use  the  severity 
and  probability  categories  in  their  descrip¬ 
tive  form,  we  developed  numerical  val¬ 
ues  for  them.  These  hazard  severity  (Sj^) 
and  hazard  probability  (P^)  values  were 
key  factors  in  using  the  model  and  pro¬ 
vided  for  a  range  of  medical  cost  and  out¬ 
come  values.  We  obtained  consensus  on 
the  values  from  practicing  health  hazard 
assessment  experts  from  the  U.S.  Army 
Center  for  Health  Promotion  and  Preven¬ 
tive  Medicine  (USACHPPM). 

Health  Hazard  Iink 

Next,  we  linked  each  of  the  nine  health 
hazard  categories  (Figure  2)  to  potential 
types  of  clinic  services  that  might  be  re¬ 
quired  as  a  result  of  exposure  to  a  specific 
health  hazard;  and  diagnostic  categories 
based  on  the  potential  medical  effects  that 
could  occur  as  a  result  of  exposure  to  a 
specific  health  hazard.  We  obtained  data 
on  the  types  of  clinic  services  from  the 
Federal  Register,  and  hospitalization,  lost 
time,  and  disability  diagnostic  data  from 
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the  Army,  the  Department  of  Labor,  and 
the  Department  of  Veterans  Affairs,  re¬ 
spectively. 

There  are  nine  Army  health  hazard  cat¬ 
egories.  Exposure  to  an  individual  hazard 
in  one  of  these  categories  can  result  in  a 
variety  of  injury  and  illness.  The  classifi¬ 
cation  (coding)  of  injury  and  illness  var¬ 
ies.  This  is  because  almost  every  national 
data  collection  agency  codes  injury  or  ill¬ 
ness  descriptions  differently.  For  example, 
the  data  we  used  classified: 

•  hospitalization  medical  diagnoses  us¬ 
ing  the  International  Classification  of 
Disease  (9th  revision)  (ICD-9)  diag¬ 
nosis  categories; 


•  lost  time  diagnoses  using  the  Bureau 
of  Labor  Statistics  Occupational  Injury 
and  Illness  Classification  System;  and 

•  disability  diagnoses  using  the  Depart¬ 
ment  of  Veterans  Affairs  Disability 
Classification  System. 

An  exposure  to  a  chemical  substance 
health  hazard  could  result  in  a: 

•  visit  to  an  “emergency  care”  clinic; 

•  hospitalization  diagnosis  of  disease  of 
the  respiratory  system; 

•  lost  time  diagnosis  of  exposure  to  caus¬ 
tic,  noxious,  or  allergic  substances;  and 
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•  disability  diagnosis  affecting  the  lungs 
and  pleura. 

While  these  diagnostic  category  clas¬ 
sifications  may  not  be  comparable  be¬ 
tween  data  sets;  this  did  not  present  a  prob¬ 
lem  in  determining  medical  costs,  because 
we  calculate  costs  using  the  appropriate 
data  set  for  each  cost  component. 

Risk  Ievel  Link 

We  then  correlated  the  industry  catego¬ 
ries  of  high,  medium,  and  low  health  risk 
with  Army  system  categories.  This  would 
allow  us  to  use  representative  industry  data 
for  evaluating  materiel  health  hazards. 

We  used  1993  data  from  the  Bureau  of 
Labor  Statistics  representative  of  the  range 
of  illness  and  injury  rates  within  the  Army. 
We  selected  industries  with  a  high,  me¬ 
dium,  and  low  incidence  of  illness  and 
injury.  For  example: 

•  The  construction  industry  represents 
high  health-risk  occupations  (12.2  in¬ 
juries  or  illnesses  per  100  full-time 
workers  per  year). 

•  The  transportation  industry  represents 
occupations  with  medium  health  risk 
(9.5  injuries  or  illnesses  per  100  full¬ 
time  workers  per  year). 

•  The  service  industry  represents  occu¬ 
pations  with  low  health  risk  (6.7  inju¬ 
ries  or  illnesses  per  100  full-time  work¬ 
ers  per  year). 

We  analyzed  each  of  the  categories  of 
military  systems  to  determine  the  appro¬ 
priate  industry  illness  and  injury  incidence 
rate  to  apply  to  each  system  category.  We 
based  our  analysis  on  limited  Army  illness 


and  injury  data  and  the  experience  of  a 
group  of  senior  medical  health  risk  asses¬ 
sors  who  had  worked  with  these  systems. 
Table  2  shows  the  correlation  between  the 
system  categories,  industry  categories,  and 
incidence  (health  risk)  levels — high,  me¬ 
dium,  or  low — we  used  to  estimate  the 
model  component  costs. 

Determining  Costs 

We  developed  equations  for  estimating 
costs  that  incorporated  hazard  severity  and 
probability  of  exposure  to  the  hazard 
(Table  3).  Table  4  provides  the  equation 
variables  and  their  values  along  with  a 
brief  description.  The  equations  include 
costs  per  year  for  clinic  services,  hospi¬ 
talization,  lost  time,  disability,  rehabilita¬ 
tion,  and  death. 

We  used  industry-wide  incidence  rates, 
distribution  factors,  and  other  rates  for 
injury,  lost  time,  hospitalization,  disabil¬ 
ity,  rehabilitation,  and  death  to  quantify 
health  hazard  costs  based  on  the  six  cost 
components — our  model  framework — to 
estimate  the  costs  of  exposure  to  hazards. 
Below  we  describe  the  calculation  of  each 
of  the  cost  components; 

Clinic  costs  (C^).  Our  primary  source 
of  illness  and  injury  data  was  the  U.S. 
Department  of  Labor  Bureau  of  Labor 
Statistics  Survey  on  U.S.  Occupational 
Injuries  and  Illnesses  for  1993,  Decem¬ 
ber  1994.  We  selected  incidence  of  illness 
and  injury  data  from  the  Bureau  of  Labor 
Statistics  data  representative  of  the  range 
of  illness  and  injury  rates  within  the  Army. 
We  selected  the  industry  categories  with 
a  high,  medium,  and  low  incidence  of  ill¬ 
ness  and  injury  as  previously  discussed. 

We  analyzed  each  of  the  categories  of 
materiel  systems  to  determine  the  appro¬ 
priate  illness  and  injury  incidence  rate  (I.) 
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Table  1. 

Correspondence  of  Risk  Levels  for  Industries  and  Materiel  Systems 


System  category 

Industry  category 

Assigned  risk  level 

Armored  fighting  vehicles 

Construction 

High 

Engineer  and  logistics  equipment 

Construction 

High 

Missile  artillery 

Construction 

High 

Tube  artillery 

Construction 

High 

Air  defense  systems 

Transportation 

Medium 

Aircraft  technology  and  armament 

Transportation 

Medium 

Ground  antitank  weapons 

Transportation 

Medium 

Infantry  weapons 

Transportation 

Medium 

Other 

Transportation 

Medium 

Smokes  and  obscurants 

Transportation 

Medium 

Chemical  defense  equipment 

Service 

Low 

Clothing  and  individual  equipment 

Service 

Low 

Communications^  command,  and  control 

Service 

Low 

Surveillance,  fire  control,  and  electronic  warfare 

Service 

Low 

Training  devices 

Service 

Low 

to  apply  to  each  system  category.  Addi¬ 
tionally,  we  queried  historical  health  haz¬ 
ard  assessment  data  to  determine  the  num¬ 
ber  of  hazards  and  their  RACs  for  each 
system  category.  We  rank  ordered  the  sys¬ 
tem  categories  using  a  RAC  weighted 
comparison  technique.  We  based  our 
analysis  on  limited  Army  illness  and  in¬ 
jury  data  and  the  experience  of  a  group  of 
senior  medical  health  risk  assessors  who 
had  worked  with  these  systems.  The  se¬ 
lected  incidence  (health  risk)  levels — 
high,  medium,  or  low — are  used  to  esti¬ 
mate  the  model  component  costs.  These 
values  are  listed  in  Table  5. 

We  developed  the  values  for  the  num¬ 
ber  of  clinic  visits  (N^)  by  injured  or  ill 
soldiers  based  on  the  seriousness  of  the 
medical  effects  that  could  occur.  As  the 
severity  of  the  medical  effects  increases 
the  number  of  clinic  visits  would  be  ex¬ 
pected  to  increase.  We  subjectively  deter¬ 


mined  the  values  based  on  a  consensus  of 
internal  and  external  panel  of  subject  mat¬ 
ter  experts.  The  values  we  selected  for 
each  hazard  severity  category  are  listed 
in  Table  6. 

Hospitalization  costs  (C^).  Our  pri¬ 
mary  sources  for  hospitalization  data  were 
the  U.S.  Army  Center  for  Health  Promo¬ 
tion  and  Preventive  Medicine 
(USACHPPM)  Medical  Surveillance 
Monthly  Report,  April  1995,  and 
“CHAMPUS  DRG  Weights  for  Fiscal 
Year  1996”  published  in  the  Federal  Reg¬ 
ister. 

We  correlated  selected  classifications  of 
illness  or  injury  diagnoses  with  the  cat¬ 
egories  of  health  hazards,  as  previously 
discussed.  We  considered  these  data  rep¬ 
resentative  of  the  range  of  hospitalization 
rates  within  the  Army  for  hazards  associ¬ 
ated  with  weapon  systems.  We  then  cal¬ 
culated  incidences  of  hospitalization  (y 
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Table  3.  Cost  Component  Equations 


Related  Cost 
Component 

Component 

calculation 

Equation 

All  (except 
death  costs] 

Number  of  people 
exposed  to  hazard 

N,  =  P,xN,xN^3 

Clinic  costs 

Number  of  people 
injured  or  ill 

Ni  =  NeXS,xl, 

Clinic  costs 

Clinic  costs 

Ce  =  N,xF, 

Clinic  costs 

Number  of  clinic  visits 

Nv  =  NeXS,x[V,  +  (l,xN^)] 

Hospitalization 

costs 

Hospitalization  costs 

C,  =  N,xF, 

Hospitalization 

costs 

Number  of  persons 
hospitalized 

Nph  =  NeXS,Xl, 

Hospitalization 

costs 

Number  of  hospital  days 

Nh  =  NeXS,xl,xI(D,,xDJ 

Lost  time  costs 

Lost  time  costs 

C,  =  N,xW,xB, 

Lost  time  costs 

Number  of  persons 
losing  time 

Np,  =  N,xS,xl, 

Lost  time  costs 

Number  of  lost 
workdays 

N,  =  N,xS,xI,xI(D„xD,) 

Disability  costs 

Disability  costs 

=  Np  X  X  l^x  X I  (D„  X  B^)  x  12  mo/yr 
+  [(l.xB,)  +  {lpXB^] 

Disability  costs 

Number  of  persons 
disabled 

Npa  =  NpXS,x(T,xl,+l.  +  g 

Rehabilitation 

costs 

Rehabilitation  costs 

C^  =  N^xS,xl^xT^xID^xQ^xB^ 

Rehabilitation 

costs 

Number  of  rehabilitation 
cases 

Nr  =  NeXS,xl,xT^xID^xQ^ 

Death  costs 

Death  costs 

C.e  =  {N,pXBJ 

Note:  Number  of  people  exposed  to  hazard  (N^  = 
nents  except  death  costs. 

X  Ns  X  N^  is  a  common  term  related  to  all  cost  compo* 
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Table  4.  Equation  Variables 


Related  cost 
component 

Equation 

variable 

Variable 

value 

Description 

All  (except 
death  costs) 

p. 

See  Table  1 

Hazard  Probability  (HP)  -  Probability  of 
exposure  per  year,  based  on  the  determined 
hazard  probability  category 

All  (except 
death  costs) 

Sk 

See  Table  1 

Hazard  Severity  (HS)  factor  based  on  the 
determined  hazard  severity  category 

All  (except 
death  costs) 

N. 

No.  of  systems 

Number  of  systems,  the  total  number  individual 
items  of  materiel,  equipment,  or  weapon 
systems  in  Army  inventory 

All  (except 
death  costs) 

Np. 

No.  of  persons 

Number  of  persons  per  system,  or  crew  size 
for  system,  or  item 

All  (except 
death  costs) 

N. 

Calculated 

Total  number  of  people  exposed  to  hazard  per 
year  for  the  systems  or  items 

Clinic  costs 

Cc 

Calculated 

Cost  of  clinic  visits 

Clinic  costs 

N, 

Calculated 

Number  of  people  injured  or  ill 

Clinic  costs 

N. 

Calculated 

Number  of  clinic  visits 

Clinic  costs 

V. 

0.75 

Visit  constant  as  result  of  exposure.  The  visit 
constant  (Ve)  equals  0.75  and  is  based  on  expo¬ 
sure  to  a  health  hazard  that  results  in  illness  or 
injury.  We  assumed  that  if  an  exposure  event 
occurs,  then  75  percent  of  all  persons  exposed 
to  the  hazard  will  visit  the  clinic  for  an  examina¬ 
tion  to  determine  whether  any  injury  has 
occurred. 

Clinic  costs 

See  Table  5 

Incidence  of  injury  or  illness  based  on  the 
determined  risk  level  for  the  individual  item  of 
materiel 

Clinic  costs 

Nc 

See  Table  6 

Number  of  visits  by  injured  or  ill  personnel  based 
on  the  determined  hazard  severity  category.  The 
hazard  severity  category  determines  the  serious¬ 
ness  of  the  medical  outcomes  that  could  occur. 
As  the  severity  increases,  the  number  of  clinic 
visits  increases.  For  this  cost  component,  based 
on  values  selected  by  a  panel  of  experts,  we 
assigned  the  number  of  visits  based  on  the 
hazard  severity  category  and  the  potential 
medical  outcomes. 

Clinic  costs 

Pc 

$122  per  visit 

Average  fee  per  clinic  visit,  based  on  the 
average  of  various  types  of  clinic  service  visit 
fees.  We  found  the  average  fee  was  $122  per 
clinic  visit. 

453 


Acquisition  Review  Quarterly — Fall  1997 


Table  4.  Equation  Variables  (conilnued) 


Hospitalization 

costs 

Ch 

Calculated 

Cost  of  hospitalization 

Hospitalization 

costs 

Np. 

Calculated 

Number  of  persons  hospitalized 

Hospitalization 

costs 

Np 

Calculated 

Number  of  hospital  days 

Hospitalization 

costs 

■ 

See  Table  7 

Incidence  of  hospitalization  based  on  the 
determined  risk  level  for  the  individual  item  of 
materiel 

Hospitalization 

costs 

Dpp 

See  Table  8 

Factor  for  the  average  number  of  days  in 
hospital  per  person  based  on  historical  hospital 
stay  distribution 

Hospitalization 

costs 

Dko 

See  Table  9 

Factor  for  the  hospitalization  population 
distribution  for  average  number  of  days  in 
hospital 

Hospitalization 

costs 

1 

$1i669  per  day 

Average  fee  per  hospital  day.  Average  cost  based 
on  various  types  of  hospital  diagnosis-related 
groups  and  the  classification  of  the  disease.  We 
found  the  average  hospital  fee  was  $1 ,669  per 
day. 

Lost  time  costs 

c, 

Calculated 

Cost  of  days  of  lost  time 

Lost  time  costs 

Np. 

Calculated 

Number  of  persons  losing  time 

Lost  time  costs 

N, 

Calculated 

Number  of  lost  workdays 

Lost  time  costs 

■ 

See  Table  10 

Incidence  of  lost  time  based  on  the  determined 
risk  level  for  the  individual  materiel  item 

Lost  time  costs 

% 

See  Table  11 

Factor  for  the  number  of  lost  workdays  per 
person  based  on  historical  lost  workday 
distribution 

Lost  time  costs 

See  Table  12 

Lost  time  population  distribution  based  on 
average  lost  workday  distribution 

Lost  time  costs 

Wp 

$53.97  per  day 

Average  wage  per  day.  We  based  the  average 
wage  per  day  (Wd)  on  the  salaries  and  numbers 
of  persons  drawing  that  salary  for  a  selected 
group  of  personnel.  We  determined  an  average 
wage  to  be  $53.97  per  day. 

Lost  time  costs 

B, 

1.41 

Wage  fringe  benefit  factor.  We  assigned  the  fringe 
benefit  factor  (Bf)a  value  of  1.41.  It  is  a  standard 
factor  within  the  government  used  for  program¬ 
ming  personnel  budget  requirements  and  is 
representative  of  other  corporate  benefit  factors. 

Disability  costs 

Cp, 

Calculated 

Cost  of  disabilities 

454 


Estimating  the  Health  Hazard  Costs  of  Army  Materiel 


Table  4.  Equation  Variables  (continued) 


Disability  costs 

Np. 

Calculated 

Number  of  persons  disabled 

Disability  costs 

■ 

See  Table  13 

Incidence  of  VA  disability  based  on  the  deter¬ 
mined  risk  level  for  the  individual  item  of 
materiel,  equipment,  or  weapon  system 

Disability  costs 

■ 

0.25 

VA  disability  adjustment  factor  for  delayed 
disability  (5  years/20  years) 

Disability  costs 

B 

See  Table  14 

VA  disability  population  factor  based  on 
historical  rate  of  disability  distribution 

Disability  costs 

B, 

See  Table  15 

VA  disability  compensation  factor  per  month 
per  rate  of  disability 

Disability  costs 

B 

0.001 

Incidence  of  active-duty  temporary  disability 
(1  case/1000  persons) 

Disability  costs 

B. 

$9,242  per 
person 

Active-duty  temporary  disability  compensation 
per  year 

Disability  costs 

P 

0.011 

Incidence  of  active-duty  permanent  disability 
(11  cases/1000  persons) 

Disability  costs 

Bp 

$12,864  per 
person 

Active  duty  permanent  disability  compensation 
per  year 

Rehabilitation 

costs 

c, 

Calculated 

Cost  of  rehabilitation 

Rehabilitation 

costs 

N, 

Calculated 

Number  of  rehabilitation  cases 

Rehabilitation 

costs 

■ 

See  Table  16 

Eligible  VA  disability  population  factor  based  on 
rate  of  disability  distribution  equal  to  or  greater 
than  20  percent 

Rehabilitation 

costs 

Qr 

0.05 

VA  rehabilitation  qualification  factor 
(5  cases/100  persons  eligible) 

Rehabilitation 

costs 

B, 

$12,000  per 
year  per  person 

VA  rehabilitation  benefit  per  year  per  person.  We 
estimated  to  be  $12,000  per  year  per  person. 
Rehabilitation  benefits  may  vary  per  person,  but 
we  considered  $12,000  to  be  a  reasonable 
estimate.  Other  benefits  may  be  available  for 
eligible  disabled  persons,  but  we  did  not  consider 
these  other  benefits. 

Death  costs 

^de 

Calculated 

Cost  of  death 

Death  costs 

Np. 

See  Table  17 

Number  of  deaths  per  year 

Death  costs 

B,. 

$200,000 

Death  benefit  and  expenses 
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Table  5.  Incidence  of  Illness  or  Injury  (I,)  for  System  Risk  Categories 


Table  6.  Number  of  Clinic  Visits  (N,)  for  Hazard  Severity  Categories 


Table  7*  Incidence  of  Hospitalization  (I  J  for  System  Risk  Categories 


System  risk  category 

Hospitalization  rate  (1^) 

High 

0.013 

Medium 

0.007 

Low 

0.0005 

Table  8. 

Factors  for  Average  Number  of  Days  in  Hospital  (D^^)  (days/person) 


Length  of  stay  in  hospital 

Factor  (D  J 

<2  days 

1.0 

2-5  days 

3.5 

6-30  days 

18.0 

>30  days 

30.0 

Table  9.  Factors  for  Hospitalization  Population  Distribution  (D^,) 
by  Length  of  Stay  in  Hospital  for  System  Risk  Categories 
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Table  10.  Incidence  of  Lest  Time  (I,)  for  System  Risk  Categories 


System  risk  category 

Lost  time  rate  (ij 

High 

0.055 

Medium 

0.054 

Low 

0.028 

Table  11. 

Factors  for  Average  Number  of  Days  of  Lost  Time  (D,j)  (days/persen) 

Number  days  of  lost  time 

Factor  (D  J 

<2  days 

1.0 

2-5  days 

3.5 

6-30  days 

18.0 

>30  days 

30.0 

Table  12.  Factors  for  Lost  Time  Population  Distribution  (D„) 
by  Days  of  Lost  Time  for  System  Risk  Categories 


System  risk  category 

Lost  time 

<2  days 

2-5  days 

6-30  days 

>30  days 

High 

0.22 

0.30 

0.29 

0.20 

Medium 

0.20 

0.33 

0.31 

0.16 

Low 

0.15 

0.43 

0.38 

0.04 

Table  13.  Incidence  of  VA  Disability  (1^  for  System  Risk  Categories 


System  risk  category 

VA  disability  factor  (IJ 

High 

0.032 

Medium 

0.012 

Low 

0.00005 

Table  1 4.  Factors  for  Disability  Population  Distribution  (DJ 
by  Degree  of  Disabiiity  for  System  Risk  Categories 


System  risk  category 

Degree  of  disability 

10% 

20%-50% 

60%-90% 

100% 

High 

mggm 

0.04 

Medium 

mmm 

mim 

0.03 

Low 

■■ 

0.48 

0.01 
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from  the  historical  data.  We  assigned  an 
appropriate  incidence  of  hospitalization  to 
the  system  categories,  just  as  we  did  with 
the  incidence  of  illness  and  injury.  The 
high-  and  low-risk  category  values  repre¬ 
sent  the  medium  (mean)  risk  category 
value  plus  or  minus  one  standard  devia¬ 
tion  respectively.  The  values  are  listed  in 
Table  7. 

We  based  the  factor  for  the  average 
number  of  days  in  the  hospital  on 
historical  hospital  length-of-stay  data.  This 
approach  provides  for  a  future  capability 
to  discriminate  between  hospital  stay 

times  (bed 

;  :"The  primary  ^7^)’  ^ 

■  sources  for  our  lost  relates  directly 

B  lime  data  are  from  with  the  hospi- 

;  the  Bureau  of  Labor  ;  talization  popu- 

Stalislics."  lation  distribu¬ 

tion.  For  this 
model  component,  we  determined  numeri¬ 
cal  factors  for  the  four  categories  of  days 
in  the  hospital.  The  category  values  rep¬ 
resent  the  midpoints  of  the  range  of  days 
in  each  category.  The  exception  is  the 
greater  than  30-day  category.  Because  the 
historical  data  available  only  listed  the  bed 
days  as  greater  than  30  days,  we  selected 
a  conservative  value  of  30  days  for  this 
category.  The  values  are  listed  in  Table  8. 

We  based  the  factor  for  the  hospitaliza¬ 
tion  population  distribution  (D,^^)  on  his¬ 
torical  data  for  the  percentage  of  persons 
hospitalized  for  four  selected  hospital 
length-of-stay  distribution  categories.  This 
distribution  approach,  when  combined 
with  the  factor  for  the  average  number  of 
days  in  the  hospital,  provides  a  future  ca¬ 
pability  to  discriminate  between  hospital 
length  of  stay  categories.  For  this  model 
component  we  determined  numerical  val¬ 
ues  for  the  four  hospitalization  population 


distribution  factors  within  each  risk  cat¬ 
egory  based  on  the  historical  data.  The 
high-  and  low-risk  category  factors  within 
each  length  of  stay  category  represent 
normalized  values  of  the  medium  (mean) 
values  plus  or  minus  one  standard  devia¬ 
tion.  The  system  risk  categories  with  their 
distribution  factors  are  listed  in  Table  9. 

Lost  time  costs  (C,).  The  primary 
sources  for  our  lost  time  data  are  from  the 
Bureau  of  Labor  Statistics.  These  included 
Results  of  Labor  Statistics  Survey  on  U.S. 
Occupational  Injuries,  Illnesses  in  1993 
and  tabular  data  on  the  percentage  distri¬ 
bution  of  nonfatal  occupational  injuries 
and  illnesses  involving  days  away  from 
work  for  1992. 

We  correlated  selected  Department  of 
Labor  illness  or  injury  categories  with  the 
categories  of  health  hazards.  We  consid¬ 
ered  the  data  representative  of  the  range 
of  lost  time  rates  within  the  Army  for  haz¬ 
ards  associated  with  materiel  systems.  We 
then  selected  incidence  of  lost  time  rates 
(Ij)  from  the  historical  data  and  the  three 
industry  categories  previously  discussed. 
We  assigned  the  selected  incidence  of  lost 
time  rates  to  the  system  categories,  just  as 
we  did  with  the  incidence  rates  for  illness 
and  injury  and  of  hospitalization.  These 
values  are  listed  in  Table  10. 

We  based  the  factor  for  the  average 
number  of  days  of  lost  time  (D|j)  on  his¬ 
torical  distribution  data  for  lost  workdays. 
This  approach  provides  a  future  capabil¬ 
ity  to  discriminate  between  selected  lost 
day  categories  and  correlates  directly  with 
the  lost  time  population  distribution.  For 
this  model  component  we  determined  nu¬ 
merical  values  for  the  four  categories  of 
lost  time.  These  factors  were  determined 
in  the  same  manner  as  the  hospital  fac¬ 
tors.  The  values  are  listed  in  Table  1 1 . 
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We  based  the  factor  for  lost  time  popu¬ 
lation  distribution  (D^)  on  historical  data 
for  the  percentage  of  persons  losing  time 
for  four  selected  lost  workday  distribution 
categories.  This  distribution  approach, 
when  combined  with  the  factor  for  the 
average  number  of  days  of  lost  time,  pro¬ 
vides  for  a  future  capability  to  discrimi¬ 
nate  between  lost  workday  categories.  For 
this  model  component,  we  determined 
numerical  values  for  the  four  lost  time 
population  distribution  factors  based  on 
historical  data.  The  high-  and  low-risk 
categories  within  each  length  of  lost  time 
category  represent  the  normalized  values 
of  the  medium  (mean)  values  plus  or  mi¬ 
nus  one  standard  deviation.  The  values  are 
listed  in  Table  12. 

Disability  costs  (C^,).  The  primary 
source  for  our  VA  disability  data  was  the 
Department  of  Veterans  Affairs,  National 
Center  for  Veteran  Analysis  and  Statistics, 
Demographics  Division.  A  report  by  the 
Armed  Forces  Epidemiological  Board  In¬ 
jury  Prevention  and  Control  Work  Group 
provided  information  on  active-duty  tem¬ 
porary  and  permanent  disability. 

Disability  costs  (C^.)  consist  of  costs  for 
delayed  VA  disability  and  more  immedi¬ 
ate  active-duty  disability.  Active-duty  dis¬ 
ability  is  either  temporary  or  permanent. 

We  selected  the  incidence  of  VA  dis¬ 
ability  (I^)  from  reports  by  the  National 
Center  for  Veteran  Analysis  and  Statistics 
involving  disability  compensation  by  class 
of  major  disability  by  combined  degree. 
The  data  were  current  as  of  March  1995. 
We  correlated  selected  classification  of 
illness  or  injury  diagnoses  with  the  cat¬ 
egories  of  health  hazards.  We  considered 
these  data  representative  of  the  range  of 
disability  rates  within  the  Army  for  haz¬ 
ards  associated  with  weapon  systems.  We 


then  calculated  incidence  of  disability 
rates  from  the  historical  Persian  Gulf  dis¬ 
ability  data.  The  high-  and  low-risk  cat¬ 
egory  levels  represent  the  medium  (mean) 
value  plus  or  minus  one  standard  devia¬ 
tion.  Because  the  value  for  the  low-risk 
value  was  a  negative  number,  we  selected 
the  range  minimum  value  for  the  low-risk 
category.  We  assigned  an  appropriate  in¬ 
cidence  of  disability  to  the  system  catego¬ 
ries,  just  as  we  did  with  the  incidence  of 
illness  and  injury.  The  values  are  listed  in 
Table  13. 

We  selected  incidence  of  active-duty 
temporary  disability  (1^)  and  incidence  of 
active-duty  permanent  disability  (1^)  from 
a  report  by  the 
Armed  Forces 

. . V'The  primary 

Epidemiologi- ;  ,our*e  for  oor  VA 

cal  Board  hyury  disability  data  was 
the  Department  of 
Veterans  Affairs,  i;: 
National  Center  for 
Veteran  Analysis 
and  Statistics, 
Demographics 
Division." 


Prevention  and 
Control  Work 
Group  on  ill¬ 
ness  and  injury. 

Its  report  pro¬ 
vided  basic  in¬ 
formation  on 
active-duty 

temporary  and  permanent  disability  com¬ 
pensation.  We  calculated  a  temporary  dis¬ 
ability  incidence  rate  of  1  case  per  1,000 
persons.  This  equates  to  an  factor  of  0.001 . 
For  permanent  disability,  we  calculated  an 
incidence  rate  of  11  cases  per  1,000  per¬ 
sons  for  a  factor  of  0.011.  We  calculated 
single  rates  only  because  of  the  limited 
data  presented  in  the  report. 

The  VA  disability  adjustment  factor  (T^) 
reduces  the  VA  disability  population.  Eli¬ 
gible  veterans  may  receive  VA  disability 
after  leaving  military  service.  One  would 
likely  see  disabilities  compensated  by  the 
VA  only  later  in  the  life  of  a  system.  We 
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assumed  that  for  a  system  with  an  opera¬ 
tional  life  of  20  years,  eligible  veterans 
would  receive  VA  disabilities  at  15  years. 
This  means  that  we  would  only  expect 
disabilities  during  the  last  5  years  of  a 
system’s  operational  life.  This  correlates 
to  a  factor  of  0.25  (5  years/20  years). 

We  based  the  disability  population  dis¬ 
tribution  factor  (D^)  on  historical  data  for 
the  percentage  of  persons  disabled  for  four 

selected  disabil¬ 
ity  distribution 
categories.  VA 
establishes  dis¬ 
ability  in  10 
percent  incre¬ 
ments.  The  four 
categories  al¬ 
low  for  the  fu¬ 
ture  capability 
to  discriminate 
between  cat¬ 
egories  of  dis¬ 
ability  costs. 
Based  on  the  historical  data,  we  assigned 
a  distribution  factor  for  each  risk  category. 
The  high-  and  low-risk  category  levels 
represent  the  normalized  values  of  the 
medium  (mean)  values  plus  or  minus  one 
standard  deviation.  These  factors  are  listed 
in  Table  14. 

We  based  the  VA  disability  compensa¬ 
tion  (B^)  factor  on  historical  data  for  se¬ 
lected  degree  of  disability  categories.  The 
approach,  when  combined  with  the  VA 
disability  population  distribution  factor  for 
degree  of  disability,  provides  the  future 
capability  to  discriminate  between  catego¬ 
ries  of  disability  costs.  The  values  are 
listed  in  Table  15. 

We  based  the  active-duty  temporary 
disability  compensation  factor  (B^)  and  the 
active-duty  permanent  disability  compen¬ 


sation  factor  (Bp)  on  1990  historical  com¬ 
pensation  costs  for  permanent  and  tem¬ 
porary  disability  in  the  three  military  ser¬ 
vices.  Using  this  data  provides  the  future 
capability  to  discriminate  between  mili¬ 
tary  and  VA  disability  costs.  The  calcu¬ 
lated  values,  from  the  historical  data,  for 
Bj  and  Bp  respectively  are  $9,242  per  per¬ 
son  and  $12,864  per  person. 

Rehabilitation  costs  (C^).  The  primary 
source  of  our  rehabilitation  data  was  the 
Department  of  Veterans  Affairs  fact  sheets. 
We  selected  the  incidence  of  VA  disabil¬ 
ity  (I^)  from  the  National  Center  for  Vet¬ 
eran  Analysis  and  Statistics  database  re¬ 
ports.  These  values  are  the  same  as  those 
listed  in  Table  13. 

As  previously  discussed,  the  VA  disabil¬ 
ity  adjustment  factor  (T^)  reduces  the  VA 
disability  population.  Eligible  veterans 
receive  VA  disability  after  leaving  mili¬ 
tary  service.  We  calculated  a  value  of  0.25 
(5  years/20  years). 

We  selected  the  factor  for  the  eligible 
VA  disability  population  distribution  (D^) 
based  on  historical  data  for  the  percent¬ 
age  of  persons  disabled  for  three  selected 
disability  distribution  categories.  The  val¬ 
ues  in  Table  1 6  are  the  same  as  those  listed 
in  Table  14  with  the  exception  of  the  10 
percent  category.  Eligibility  for  rehabili¬ 
tation  is  limited  to  people  with  a  disabil¬ 
ity  of  20  percent  or  more.  This  distribu¬ 
tion  approach  provides  a  future  capabil¬ 
ity  to  discriminate  between  categories  of 
rehabilitation  costs. 

We  assumed  the  qualification  factor  for 
rehabilitation  (Q^)  to  be  0.05  (5  cases  per 
100  persons  eligible).  We  selected  this 
value  based  on  a  subjective  estimate  of  the 
percentage  of  people  who  may  apply  for 
and  be  accepted  for  rehabilitation  benefits. 
The  qualification  factor  selected  may  be 


"The  primary  source 
of  our  rehabililalien 
data  was  the  De¬ 
partment  of  Veter¬ 
ans  Affairs  fact 
sheets.  We  selected 
the  incidence  Of  VA 
disability  (I J  from 
the  National  Center 
for  Veteran  Analysis 
and  Statistics  data¬ 
base  reports." 
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low ;  for  example,  one  VA  region  estimated 
its  acceptance  rate  for  the  VA  rehabilita¬ 
tion  program  to  be  greater  than  20  per¬ 
cent.  However,  we  consider  the  value  ad¬ 
equate  for  use  in  the  MCAM. 

Death  costs  (C^^).  The  primary  source 
of  death  data  was  a  report  by  the  Armed 
Forces  Epidemiological  Board  Injury  Pre¬ 
vention  and  Control  Work  Group  and  the 
death  benefit  paid  by  the  Serviceman’s 
Group  Life  Insurance. 

We  assumed  that  a  potential  for  death 
existed  only  in  the  catastrophic  hazard 
severity  category.  There  were  limited  re¬ 
liable  sources  of  data.  This  is  an  area  re¬ 
quiring  further  research  to  refine  the 
MCAM.  The  report  by  the  Armed  Forces 
Epidemiological  Board  Injury  Prevention 
and  Control  Work  Group  showed  that 
overall  there  was  approximately  1  death 
per  1,000  clinic  visits.  This  number  is 
based  on  the  assumption  that  if  a  death 
were  to  occur,  program  managers  would 
take  immediate  action  to  eliminate  or  re¬ 
duce  the  hazard.  We  used  the  values  in 
Table  17  to  estimate  number  of  deaths 

(NJ. 

There  is  great  variability  in  calculating 
the  cost  of  a  person’s  death.  Values  pre¬ 
sented  in  the  literature  have  varied  from 
over  $100,000  to  over  $1  million.  Our  cost 
of  death  includes  costs  paid  by  insurance 
policies  plus  expenses  relating  to  casualty 
assistance,  honor  guard,  funeral  and  burial, 
family,  and  other  related  expenses. 
Serviceman’s  Group  Life  Insurance  can 
pay  a  beneficiary  up  to  $200,000  for  the 
death  of  a  soldier.  Other  expenses  incurred 
by  the  Army  can  be  substantial.  As  previ¬ 
ously  discussed,  we  did  not  consider  train¬ 
ing  and  personnel  replacement  costs. 


Results 


We  developed  a  framework  and  equa¬ 
tions  with  appropriate  variables  for  esti¬ 
mating  reasonable  costs  for  unabated 
health  hazards  in  Army  materiel.  We  de¬ 
veloped  reasonable  cost  estimates  by 
quantifying  medical  costs  associated  with 
unabated  materiel  system  health  hazards. 
The  model’s  lost  time  component  identi¬ 
fies  personnel  time  away  from  the  job,  an 
output  directly  relating  to  unit  readiness 
and  productivity. 


An  Example  Cost  Estimation 

As  an  example,  we  estimated  costs  for 
an  Army  system  (System  X)  evaluated  by 
health  hazard  assessors,  for  which  they 
wrote  a  health  hazard  assessment  report. 
Remember  that  health  hazards  are  inher¬ 
ent  in  all  U.S.  Army  materiel  systems.  If 
ignored,  however,  these  hazards  can  cause 
serious  injuries  and  illnesses  to  military 
and  civilian  operators  throughout  the  life 
of  the  system.  ; 

In  our  case,  the 
medical  costs 
for  treating 
those  injuries 
and  illnesses 
can  pose  sig¬ 
nificant  finan¬ 
cial  burdens  to 
the  Army  and 
Veterans  Affairs 

health  care  systems.  For  example,  imple¬ 
mentation  of  recommendations  to  control 
health  hazards  for  our  example  results  in 
avoiding  potential  medical  and  lost  time 
costs  greater  than  $345  million  over  the 
life  of  the  system. 

System  X  had  10  health  hazards:  weap¬ 
ons  combustion  products,  fire  extinguish- 


'^here  is  great 
variability  in  calcu* 
lating  the  cost  of  a 
person's  death. 
Values  presented  in 
the  literature  have 
varied  from  ever 
$100,000  to  ever 
$1  millien." 
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Table  1 5.  VA  Disability  Compensation  Factors  (B J  by  Degree 
of  Disabiiity  (dollars/month/person) 


Degree  of  disability 

VA  disability  compensation  factor  (B^) 

10% 

$91.00 

20%-50% 

$340.25 

60%-90% 

$915.50 

100% 

$1,865.00 

Table  1 6.  Eligible  VA  Disability  Popuiatien  Distribution  Factors  (D,) 
by  Degree  of  Disability  for  System  Risk  Categories 


System  risk  category 

10% 

Degree  of  disability 

20%-50%  60%-90% 

100% 

High 

0.0 

0.42 

0.10 

0.04 

Medium 

0.0 

0.44 

0.09 

0.03 

Low 

0.0 

0.48 

0.08 

0.01 

Tabie  1 7.  Number  of  Deaths  (N^  J  for  Hazard  Severity  Categories 


Hazard  severity  category 

Number  of  deaths  (N^^) 

1 

1 

II 

0 

III 

0 

IV 

0 

Tabie  18.  Health  Hazards  and  Associated  Risk  Indices  for  System  X 


Hazard  category 

Hazard 

Risk 

assessment 
code  (RAC) 

Hazard 

severity 

category 

Hazard 

probability 

Chemical  substances 

Weapons  combustion  products 

1 

1 

A 

Chemical  substances 

Fire  extinguishing  agents 

2 

II 

C 

Chemical  substances 

Carbon  dioxide 

3 

II 

D 

Acoustical  energy 

Impulse  noise 

2 

II 

C 

Acoustical  energy 

Steady-state  noise 

2 

II 

C 

Temperature  extremes 

Cold  stress 

2 

II 

C 

Temperature  extremes 

Heat  stress 

2 

II 

C 

Oxygen  deficiency 

Oxygen  deficiency  (ventilation) 

2 

II 

C 

Radiation  energy 

Nonionizing  radiation 

2 

II 

C 

Radiation  energy 

Ionizing  radiation 

4 

II 

E 
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Table  19. 

Life-Cycle  Costs  of  Several  Unabated  Health  Hazards  for  System  X 


Hazards 

Costs  (Thousands  of  Dollars) 

Clinic 

Hospital 

Lost 

time 

Disability 

Rehabil¬ 

itation 

Death 

Total 

Weapons  combustion 

88,402 

81,904 

27,852 

98,173 

1,432 

4,000 

301,763 

products 

Nonionizing  radiation 

1,612 

1,820 

619 

2,182 

32 

0 

6,265 

Carbon  dioxide 

81 

91 

31 

109 

2 

0 

314 

Ionizing  radiation 

8 

9 

3 

11 

0 

0 

31 

Six  other  hazards 

9,672 

10,920 

3,714 

13,092 

192 

0 

37,590 

Total 

99,800 

94,700 

32,200 

113,600 

1,700 

4,000 

346,000 

Note:  Table  totals  are  rounded  to  the  nearest  hundred  thousand. 


Table  20.  Individual  Component  Outputs  for  Selected  Hazards 
for  System  X— Yearly  Basis 


Component  outputs 

Hazard 

Clinic 

visits 

Persons 

injured/ill 

Persons 

hospitalized 

Hospital 

days 

Persons 

losing 

time 

Persons 

disabled 

Rehabil- 

tation 

cases 

Deaths 

Weapons 

combustion 

products 

36,230 

3,250 

346 

2,454 

1,465 

18,300 

533 

1 

1 

Nonionizing 

radiation 

661 

72 

8 

55 

33 

407 

12 

D 

H 

Carbon 

dioxide 

33 

4 

0 

3 

2 

20 

1 

P 

P 

Ionizing 

radiation 

3 

0 

0 

0 

0 

2 

0 

Six  other 
hazards 

3,966 

432 

48 

330 

198 

2,442 

72 

P 

P 

Total 

40,900 

3,800 

400 

2,800 

1,700 

21,200 

600 

D 

1 

Note:  Table  totals  are  rounded. 
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ing  agents,  carbon  dioxide,  impulse  noise, 
steady-state  noise,  cold  stress,  heat  stress, 
oxygen  deficiency  (ventilation),  nonion¬ 
izing  radiation,  and  ionizing  radiation. 
Table  18  lists  the  identified  health  hazards 
and  the  risk  assessment  codes  assigned  by 
the  health  hazard  assessors  during  their 
evaluation. 

We  determined  the  costs  incurred  over 
the  operational  life  (20  years)  of  the  sys¬ 
tem  as  a  result  of  unabated  health  hazards. 
These  costs  are  significant — in  this  case, 
greater  than  $345  million.  Lost  time,  dis¬ 
ability,  rehabilitation,  and  death  costs  of 
$150  million,  along  with  clinic  and  hos¬ 
pitalization 

"The  medical  cost 
data  clearly  shewed 
that  unabated 
health  hazards  can 
have  a  significant 
Impact  on  readiness 
and  the  health  care 
system  ever  the 
eperatienal  life  ef 
eur  system." 


costs  of  $195 
million,  impact 
military  readi¬ 
ness,  productiv¬ 
ity  and  the 
health  care  sys¬ 
tem.  Table  19 
summarizes  the 
model  compo¬ 
nent  life-cycle 


-  costs  for  several 
of  the  10  unabated  health  hazards  for  the 
system.  We  calculated  costs  for  one  haz¬ 
ard  in  each  risk  category.  Health  hazard 
intervention  can  reduce  these  costs.  The 
application  of  dollar  amounts  to  the  health 
hazards  provides  new  insight  into  areas 
requiring  attention  concerning  materiel 
acquisition  decision  making. 

Program  managers  can  easily  see  which 
health  hazards  require  immediate  attention 
and  priority  abatement.  They  can  deter¬ 
mine  whether  the  magnitude  of  the  costs 
could  have  a  severe  impact  on  readiness. 
The  avoidance  of  these  costs  can  make 
resources  available  for  other  use — an  im¬ 


portant  consideration  in  our  current  cost- 
constrained  environment. 

The  medical  cost  data  clearly  showed 
that  unabated  health  hazards  can  have  a 
significant  impact  on  readiness  and  the 
health  care  system  over  the  operational  life 
of  our  system.  The  individual  component 
outputs  give  a  detailed  picture  of  these 
impacts.  Table  20  summarizes  the  yearly 
individual  component  output  data  for  sev¬ 
eral  of  the  10  unabated  health  hazards. 
Again,  we  calculated  output  data  for  one 
hazard  in  each  risk  category. 

If  these  hazards  are  not  abated,  we  can 
expect  to  see  3,800  injured  or  ill  soldiers, 
1,700  soldiers  losing  time  at  work,  600 
disabled  soldiers,  and  400  hospitalized 
soldiers  on  a  yearly  basis.  This  has  a  tre¬ 
mendous  impact  on  available  manpower. 
Lost  workdays  account  for  a  total  of 
21,200  days  per  year.  Yearly,  we  can  ex¬ 
pect  40,900  clinic  visits  and  2,800  hospi¬ 
tal  days  as  a  result  of  exposure  to  health 
hazards  resulting  in  illness  and  injury.  This 
also  presents  a  great  burden  on  the  health 
care  system.  Health  hazard  intervention 
can  reduce  these  costs. 

Evaluation  of  Model 

We  assessed  the  results  of  the  medical 
cost  avoidance  model  from  the  perspec¬ 
tives  of  validity  (Did  we  measure  the  right 
things?),  reliability  (How  well  can  we 
measure  those  things?),  practicality  (Can 
we  make  a  decision  based  on  the  model 
output?),  and  sensitivity  (What  is  the  im¬ 
pact  of  the  model  output  to  possible  er¬ 
rors  in  the  data?).  Validity  and  reliability 
are  relative  measures,  not  absolute.  For  all 
of  these  perspectives,  improvements  in 
data  collection  and  source  data  will  im¬ 
prove  the  MCAM’s  validity. 
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Validity 

As  a  first  step,  the  model  produces  rea¬ 
sonable  “real  world”  results.  The  compo¬ 
nents  of  this  model  are  representative  of 
the  basic  outcomes  that  all  prevention  pro¬ 
grams  should  measure.  Most  of  the  data 
for  the  model  parameters  are  obtained 
from  actuarial-type  databases.  While  we 
linked  industry  categories  to  Army  sys¬ 
tem  categories  so  that  we  could  use  haz¬ 
ard  data  available  for  industry,  rather  than 
using  actual  Army  data,  this  substitution 
does  not  invalidate  the  model.  Existing 
Army  and  industry-wide  databases  do  not 
relate  illnesses  and  injuries  to  their  “root 
cause.”  The  degree  of  validity  of  the  model 
may  increase  with  the  exclusive  use  of 
Army  data.  We  did  not  include  some  po¬ 
tential  indirect  costs  that  could  be  incurred 
as  a  result  of  illness  or  injury.  We  do  not 
believe  that  this  detracts  from  the  utility 
of  the  model.  For  example,  some  of  these 
costs  could  include:  the  costs  to  acquire 
and  train  personnel  replacements  for  those 
soldiers  injured,  ill,  or  killed,  performance 
degradation  costs  or  the  nonmonetary  ef¬ 
fect  on  military  readiness,  and  the  costs 
related  to  the  impact  on  family  quality  of 
life. 

We  recognize  that  these  costs  could  be 
substantial  and  should  be  considered.  We 
also  recognize  that  these  costs  may  vary 
greatly;  for  example,  it  costs  more  to  train 
a  pilot  than  an  infantryman.  We  believe 
the  system  program  manager  is  in  the  best 
position  to  make  an  assessment  of  the 
impact  of  these  additional  costs. 

Reliability 

The  MCAM  outputs  are  reliable.  Its 
parameters  are  measurable  or  can  be  esti¬ 
mated.  Assuming  medical  assessors  per¬ 
form  risk  assessments  correctly  and  con¬ 


sistently,  the  model  will  produce  the  same 
outputs.  Remember  that  risk  assessments 
are  subjective  in  nature;  as  assessors  be¬ 
come  more  experienced,  then  we  would 
expect  to  see  them  assign  a  particular  haz¬ 
ard  the  same  hazard  severity,  hazard  prob¬ 
ability,  and  risk  assessment  code.  The  data 
used  in  this  model,  while  obtained  from 
industry-wide 

sources,  were  MCAM  outputs 

necessary  and  ^ 

adequate  to  ob-  parameters  are 

tain  quantitative  measurable  or  can 
cost  estimates,  be  estimated." 

The  data  are 
comprehensive 

and  reliable.  Additionally,  these  sources 
already  have  established  collection  pro¬ 
cedures,  update  their  data  annually,  and 
make  them  available  for  use.  Improved 
reliability  could  be  achieved  by  having 
outpatient  and  or  inpatient  medical  records 
provide  specific  information  concerning 
the  “root  cause”  of  an  illness  or  injury. 
Currently,  medical  records  contain  a  di¬ 
agnosis,  but  do  not  contain  the  “root 
cause.”  In  the  future  more  detailed  state¬ 
ments  in  medical  records  would  improve 
data  reliability.  An  example  of  this  kind 
of  useful  information  is:  “This  hospital 
visit  for  more  detailed  tests  was  the  result 
of  an  exposure  to  a  chemical  substance 
from  an  armored  fighting  vehicle.  It  re¬ 
sulted  in  a  respiratory  system  disease  di¬ 
agnosis  by  medical  personnel.” 

PRAaicALin 

The  validity  and  reliability  of  the 
MCAM  are  adequate  for  its  purpose  as  an 
initial  cost  estimating  model.  Its  outputs 
are  also  very  practical  to  use,  and  help 
explain  what  a  RAC  means  for  health  haz¬ 
ards  associated  with  a  particular  system. 
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Greater  data  specificity  for  hazard  and 
medical  diagnosis  should  improve  the 
understanding  of  the  monetary  impact  of 
different  hazards  with  the  same  RAC.  The 
accuracy  of  most  of  the  individual  mea¬ 
sures  could  be  improved,  but  doing  so 
would  require  research  funding. 

Sensitivity 

The  model  is  most  sensitive  to  the  se¬ 
lection  for  hazard  severity  and  hazard 
probability  (Table  1).  Once  the  matrix  cell 
has  been  selected  using  those  two  factors, 
the  model  exhibits  the  greatest  sensitivity 
to  hospital  and  clinic  costs  (Tables  20  and 
21).  Due  to  differences  in  the  sizes  of  both 
hospitals  and  clinics,  these  costs  can  vary 
significantly.  Trying  to  obtain  the  “true” 
hospital  and  clinic  costs  would  be  highly 
desirable;  however,  we  have  minimized 
extreme  cost  variations  by  averaging  his¬ 
torical  data  for  many  types  of  hospital  and 
clinical  services. 


Discussion 


We  showed  that  the  MCAM  will  esti¬ 
mate  total  costs  based  on  the  determina¬ 
tion  of  a  health  risk;  if  we  can  quantify  a 
health  risk,  then  we  can  estimate  its  costs. 
USACHPPM’s  Health  Hazard  Assess¬ 
ment  Office  is  currently  testing  an  auto¬ 
mated  version  of  the  cost  model.  We  in¬ 
corporated  the  model  into  their  health  haz¬ 
ard  assessment  database,  and  we  devel¬ 
oped  a  project  officer  module  for 
US  ACHPPM  personnel  to  use  in  perform¬ 
ing  health  hazard  assessments.  Thus  these 
estimated  costs  are  being  provided  to  pro¬ 
gram  managers,  but  we  do  not  know  how 
they  are  using  this  information.  This  is¬ 
sue  requires  dedicated  follow-up,  to  de¬ 


termine  the  efficacy  of  the  model’s  use  and 
its  potential  impact. 

Using  the  results  of  the  MCAM  can 
make  health  risk  management  more  effec¬ 
tive.  Quantifying  health  hazard  costs  im¬ 
proves  a  program  manager’s  understand¬ 
ing  of  the  monetary  impact  of  not  elimi¬ 
nating  or  mitigating  a  health  hazard.  The 
model’s  lost  time  component  identifies 
personnel  time  away  from  the  job,  an  out¬ 
put  that  directly  relates  to  unit  readiness 
and  productivity. 

The  model  is  based  on  the  events  (clinic 
visits,  hospitalization,  lost  time,  disabil¬ 
ity,  rehabilitation,  and  death)  that  can  be 
triggered  by  exposure  to  the  causes  of  dis¬ 
ease  and  injury.  It  would  therefore  be  use¬ 
ful  for  assessing  similar  hazard  interven¬ 
tion  in  other  related  programs — system 
safety,  human  factors  engineering,  and 
preventive  medicine. 

The  bottom  line  for  prevention  pro¬ 
grams  is  to  reduce  the  personal,  person¬ 
nel,  and  health  care  costs  of  unabated 
health  hazards.  To  assess  the  reduction  in 
medical  costs,  prevention  programs  can 
use  the  model’s  component  outputs  as 
performance  indicators  and  measures  of 
effectiveness. 

Other  Applications 

While  we  developed  the  MCAM  for 
assessing  the  health  hazards  in  Army  ma¬ 
teriel,  it  has  applications  that  expand  into 
other  MANPRINT  (Manpower  and  Per¬ 
sonnel  Integration)  domains  that  assess 
health  risks. 

The  model  could  be  used  in  the  follow¬ 
ing  ways: 

•  System  safety  engineers  and  human 
factors  engineers  could  estimate  medi¬ 
cal  costs  for  system  safety  and  human 
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factors  engineering  hazards  of  Army 
materiel. 

•  Industrial  hygienists  and  occupational 
health  personnel  could  estimate  medi¬ 
cal  costs  for  hazards  of  industrial  pro¬ 
duction  line  operations. 

•  Environmental  engineers  and  health 
risk  assessors  could  estimate  medical 
costs  for  hazards  associated  with  the 
cleanup  of  hazardous  waste  sites.  They 
could  also  assess  other  environmental 
health  hazards  from  environmental  pol¬ 
lution. 

•  Preventive  medicine  physicians,  envi¬ 
ronmental  science  officers,  sanitary  en¬ 
gineers,  and  community  health  nurses 
could  estimate  medical  outputs  for  en¬ 
vironmental  hazards  found  on  the 
battlefield. 

IlMITATIONS  OF  THE  MODEL 

There  are  several  limitations  to  our 

model: 

•  We  do  not  include  pollution  prevention 
savings  in  the  estimate  of  medical 
costs.  We  consider  only  potential  dol¬ 
lar  costs  avoided  for  medical  and  lost 
time  costs  related  to  the  illness  or  in¬ 
jury  caused  by  exposure  to  the  hazard. 

•  We  do  not  subtract  out  the  costs  of  the 
actual  implementation  of  health  haz¬ 
ard  assessment  recommendations. 
These  costs  depend  on  the  type  of  rec¬ 
ommendation  made,  the  degree  of  re¬ 
duction  of  the  health  hazard,  and  the 
life-cycle  phase.  Costs  may  include 
potential  publication  or  labeling,  pro¬ 


tective  equipment,  production  process 
changes,  engineering  design,  operation 
and  maintenance,  retrofitting,  and  dis¬ 
posal. 

•  We  do  not  incorporate  the  costs  to  ac¬ 
quire  and  train  replacements  for  per¬ 
sonnel  injured,  ill,  or  killed.  We  also 
do  not  incorporate  the  costs  of  de¬ 
graded  performance  or  the  nonmon¬ 
etary  effect  on  military  readiness.  Nor 
do  we  incorporate  the  costs  related  to 
the  impact  on  family  quality  of  life.  As 
we  previously  discussed,  these  costs 
could  be  substantial  and  can  be  best 
addressed  by  program  managers. 

•  We  do  not  use  only  military  data  for 
estimating  costs.  In  the  absence  of  re¬ 
quired  relevant  military  data  we  ex¬ 
trapolate  private  industry  data  and  re¬ 
late  them  to  military  systems.  We  made 
the  assumption  that  the  industry  data 
were  relevant  and  we  could  develop 
Army  materiel  risk  categories  based  on 
this  industry  data.  We  believe  the  re¬ 
sults  obtained  are  reasonable.  How¬ 
ever,  we  do  encourage  readers  to  re¬ 
search  and  apply  equation  variable  data 
appropriate  for  their  particular  opera¬ 
tion. 

We  believe  that  pollution  prevention, 
hazard  abatement,  and  other  implementa¬ 
tion  costs  would  be  minimal  compared  to 
system  procurement  costs,  when  health 
hazard  assessment  recommendations  are 
incorporated  during  system  design. 
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Conclusions 


The  framework  we  have  developed  pro¬ 
vides  a  method  to  quantify  reasonable  es¬ 
timates  of  the  medical  and  lost  time  costs 
associated  with  unabated  health  hazards 
associated  with  Army  materiel.  Using  the 
outputs  of  the  model  would  increase  the 
effectiveness  of  health  risk  assessment  and 
management. 


We  have  presented  the  model  to  stimu¬ 
late  thought  and  feedback;  it  can  and 
should  be  further  refined.  As  its  use  in¬ 
creases  and  follow-up  data  become  avail¬ 
able,  we  can  develop  more  accurate  cost 
distribution  factors,  resulting  in  more  ac¬ 
curate  forecasts  of  health  costs. 
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Research  Articles 


Manuscripts  should  reflect  research  or 
empirically-supported  experience  in  one 
or  more  of  the  aforementioned  areas  of 
acquisition.  Research  or  tutorial  articles 
should  not  exceed  4,500  words.  Opinion 
pieces  should  be  limited  to  1,500  words. 

We  publish  Defense  Acquisition  re¬ 
search  articles  that  involve  systemic  in¬ 


quiry  into  a  significant  research  question. 
The  article  must  produce  a  new  or  revised 
theory  of  interest  to  the  acquisition  com¬ 
munity.  You  must  use  a  reliable,  valid  in¬ 
strument  to  provide  your  measured  out¬ 
comes. 


Manuscript  Sections 


The  introduction  should  state  the  pur¬ 
pose  of  the  article  and  concisely  summa¬ 
rize  the  rationale  for  the  undertaking. 

The  methods  section  should  include  a 
detailed  methodology  that  clearly  de¬ 
scribes  work  performed.  Although  it  is 
appropriate  to  refer  to  previous  publica¬ 
tions  in  this  section,  the  author  should  pro¬ 
vide  enough  information  so  that  the  expe¬ 
rienced  reader  need  not  read  earlier  works 
to  gain  understanding  of  the  methodology. 

The  results  section  should  concisely 
summarize  findings  of  the  research  and 
follow  the  train  of  thought  established  in 
the  methods  section.  This  section  should 
not  refer  to  previous  publications,  but 
should  be  devoted  solely  to  the  current 
findings  of  the  author. 

The  discussion  section  should  empha¬ 
size  the  major  findings  of  the  study  and 
its  significance.  Information  presented  in 
the  aforementioned  sections  should  not  be 
repeated. 
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Research  Consideratiohs 


Contributors  should  also  consider  the 
following  questions  in  reviewing  their  re- 
search-based  articles  prior  to  submission: 

•  Is  the  research  question  significant? 

•  Are  research  instruments  reliable  and 
valid? 

•  Are  outcomes  measured  in  a  way 
clearly  related  to  the  variables  under 
study? 

•  Does  the  research  design  fully  and  un¬ 
ambiguously  test  the  hypothesis? 

•  Did  you  build  needed  controls  into  the 
study? 

Contributors  of  research-based  submis¬ 
sions  are  also  reminded  they  should  share 
any  materials  and  methodology  necessary 
to  verify  their  conclusions. 

Criteria  for  Tutorials 


Tutorials  should  provide  special  in- 
straction  or  knowledge  relevant  to  an  area 
of  defense  acquisition  to  inform  the  De¬ 
fense  Acquisition  Workforce. 

Topics  for  submissions  should  rely  on 
or  be  derived  from  observation  or  experi¬ 
ment,  rather  than  theory.  The  submission 
should  provide  knowledge  in  a  particular 
area  for  a  particular  purpose. 


Opinion  Criteria 


Opinion  articles  should  reflect  judg¬ 
ments  based  on  the  special  knowledge  of 
the  expert.  Opinion  articles  should  be 
based  on  observable  phenomena  and  pre¬ 
sented  in  a  factual  manner;  that  is,  sub¬ 
missions  should  imply  detachment.  The 
observation  and  judgment  should  not  re¬ 
flect  the  author’s  personal  feelings  or 
thoughts.  Nevertheless,  opinion  pieces 
should  clearly  express  a  fresh  point  of 
view,  rather  than  negatively  criticize  the 
view  of  another  previous  author. 

Manuscript  Style 


We  will  require  you  to  recast  your  last 
version  of  the  manuscript,  especially  ci¬ 
tations  (e.g.,  footnotes  or  endnotes)  into 
the  format  required  in  two  specific  style 
manuals.  The  ARQ  follows  the  author 
(date)  form  of  citation.  We  expect  you  to 
use  the  Publication  Manual  of  the  Ameri¬ 
can  Psychological  Association  (4th  Edi¬ 
tion),  and  the  Chicago  Manual  of  Style 
(14th  Edition).  The  ARQ  follows  the  au¬ 
thor  (date)  form  of  citation. 

Contributors  are  encouraged  to  seek  the 
advice  of  a  reference  librarian  in  complet¬ 
ing  citations  of  government  documents. 
Standard  formulas  of  citations  may  give 
only  incomplete  information  in  reference 
to  government  works.  Helpful  guidance 
is  also  available  in  Gamer,  D.L.  and  Smith, 
D.H.,  1993,  The  Complete  Guide  to  Cit¬ 
ing  Government  Documents:  A  Manual 
for  Writers  and  Librarians  (Rev.  Ed.), 
Bethesda,  MD:  Congressional  Informa¬ 
tion  Service,  Inc. 
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Copyright  Information 


The  ARQ  is  a  publication  of  the  United 
States  Government  and  as  such  is  not 
copyrighted.  Contributors  of  copyrighted 
works  and  copyright  holders  of  works  for 
hire  are  strongly  encouraged  to  request 
that  a  copyright  notification  be  placed  on 
their  published  work  as  a  safeguard  against 
unintentional  infringement.  The  work  of 
federal  employees  undertaken  as  part  of 
their  official  duties  is  not  subject  to  copy¬ 
right. 

In  citing  the  work  of  others,  it  is  the 
contributor’s  responsibility  to  obtain  per¬ 
mission  from  a  copyright  holder  if  the  pro¬ 
posed  use  exceeds  the  fair  use  provisions 
of  the  law  (see  U.S.  Government  Printing 
Office,  1994,  Circular  92:  Copyright  Law 
of  the  United  States  of  America,  p.  15, 
Washington,  DC:  Author).  Contributors 
will  be  required  to  submit  a  copy  of  the 
written  permission  to  the  editor  before 
publication. 


Manuscript  Format 


Pages  should  be  double-spaced  and  or¬ 
ganized  in  the  following  order:  title  page, 
abstract,  body,  reference  list,  author’s  note 
(if  any),  and  figures  or  tables.  To  ensure 
anonymity,  each  paper  should  be  submit¬ 
ted  with  a  separate  page  that  includes  the 
author(s)’s  name(s)  and  complete  address, 
and  the  paper  should  include  the  title,  ab¬ 
stract,  keywords,  body,  complete  set  of 
references,  along  with  tables  and  figures 
at  the  end.  Authors  are  reminded  not  to 
refer  to  themselves  or  to  their  own  work 
directly  in  the  paper.  Figures  or  tables 
should  not  be  inserted  (or  embedded,  etc.) 


into  the  text,  but  segregated  one  to  a  page 
following  the  text.  Articles  must  be  print¬ 
able  within  one  issue  and  should  not  ex¬ 
ceed  4,500  words  for  research  or  tutorials 
and  1,500  words  for  opinion  pieces;  ar¬ 
ticles  will  not  be  printed  in  parts  or  in  a 
continuing  series.  If  material  is  submitted 
on  a  computer  diskette,  each  figure  or  table 
should  be  recorded  in  a  separate,  export¬ 
able  file  (i.e.,  a  readable  .eps  file).  For 
additional  information  on  the  preparation 
of  figures  or  tables,  see  CBE  Scientific 
Illustration  Committee,  1988,  Illustrating 
Science:  Standards  for  Publication, 
Bethesda,  MD:  Council  of  Biology  Edi¬ 
tors,  Inc.  Please  restracture  briefing  charts 
and  slides  to  a  look  similar  to  those  in  pre¬ 
vious  issues  of  ARQ. 

The  author  (or  corresponding  author  in 
the  case  of  multiple  authorship)  should 
attach  to  the  manuscript  a  signed  cover 
letter  that  provides  the  author’s  name,  ad¬ 
dress,  and  telephone  number  (fax  and 
Internet  addresses  are  also  appreciated). 
The  letter  should  verify  that  the  submis¬ 
sion  is  an  original  product  of  the  author; 
that  it  has  not  been  published  before;  and 
that  it  is  not  under  consideration  by  an¬ 
other  publication.  Details  about  the  manu¬ 
script  should  also  be  included  in  this  let¬ 
ter:  for  example,  its  title,  word  length,  the 
need  for  copyright  notification,  the  iden¬ 
tification  of  copyrighted  material  for 
which  permission  must  be  obtained,  a  de¬ 
scription  of  the  computer  application  pro¬ 
grams  and  file  names  used  on  enclosed 
diskettes,  etc. 

The  letter,  one  copy  of  the  printed 
manuscript,  and  any  diskettes  should  be 
sturdily  packaged  and  mailed  to:  Defense 
Systems  Management  College,  Attn: 
DSMC  Press  (ARQ),  9820  Belvoir  Road, 
Suite  3,  Fort  Belvoir,  VA  22060-5565. 
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In  most  cases,  the  author  will  be  noti¬ 
fied  that  the  submission  has  been  received 
within  48  hours  of  its  arrival.  Following 
an  initial  review,  submissions  will  be  re¬ 
ferred  to  referees  and  subsequent  consid¬ 
eration  by  the  ARQ  Editorial  Board. 


Contributors  may  direct  their  questions 
to  the  Editor,  ARQ,  at  the  address  shown 
above,  by  calling  (703)  805-4290  (fax 
805-  2917),  or  via  the  Internet  at: 
gonzalezd  @  dsmc  .dsm.mil . 

The  DSMC  Home  Page  can  be  accessed 
at: 

http://www.dsmc.dsm.mil. 
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